Skip to content

Tracking - Testing - move fsharpqa tests to new framework #12823

New issue
New issue
Open
Open
Tracking - Testing - move fsharpqa tests to new framework#12823
Labels
PlanTracking
Milestone
 
Backlog
@KevinRansom

Description

@KevinRansom
KevinRansom
opened on Mar 9, 2022

There are a gazillion tests in fsharpQA - I will try to do them a directory at a time.
It should be noted that currently the fsharpqa tests runs only on desktop, with only a retail compiler/compilerservice. Part of this process includes extending the test to run net472/netcore, as well as debug and release. The existing framework will be updated to accommodate the additional scenarios as part of this process.

  • Also note, that desktop ildasm with desktop pdbs include source code position information which identifies sequence point information. We will need to instead use sp information from portable pdb files. @vzarytovskii , is currently updating the test infra to handle this.

  • Source\Common

  • Source\CompilerOptions

  • Source\Conformance

  • Source\Diagnostics

  • Source\EntryPoint

  • Source\Import

  • Source\InteractiveSession

  • Source\Libraries

  • Source\Misc

  • Source\MultiTargeting

  • Source\Optimizations

  • Source\Stress

  • Source\TemplatesAndSnippets

  • Source\CodeGen

  • Source\CodeGen\EmittedIL

  • Source\CodeGen\StringEncoding

  • Source\CodeGen\Structure

  • Source\CodeGen\EmittedIL\AsyncExpressionStepping

  • Source\CodeGen\EmittedIL\AttributeTargets

  • Source\CodeGen\EmittedIL\CCtorDUWithMember

  • Source\CodeGen\EmittedIL\CompiledNameAttribute

  • Source\CodeGen\EmittedIL\ComputationExpressions

  • Source\CodeGen\EmittedIL\DoNotBoxStruct

  • Source\CodeGen\EmittedIL\GeneratedIterators

  • Source\CodeGen\EmittedIL\InequalityComparison

  • Source\CodeGen\EmittedIL\ListExpressionStepping

  • Source\CodeGen\EmittedIL\MethodImplAttribute

  • Source\CodeGen\EmittedIL\Misc

  • Source\CodeGen\EmittedIL\Operators

  • Source\CodeGen\EmittedIL\QueryExpressionStepping

  • Source\CodeGen\EmittedIL\SeqExpressionStepping

  • Source\CodeGen\EmittedIL\SeqExpressionTailCalls

  • Source\CodeGen\EmittedIL\SerializableAttribute

  • Source\CodeGen\EmittedIL\StaticInit

  • Source\CodeGen\EmittedIL\SteppingMatch

  • Source\CodeGen\EmittedIL\TestFunctions

  • Source\CodeGen\EmittedIL\Tuples

  • Source\CompilerOptions\fsc

  • Source\CompilerOptions\fsi

  • Source\CompilerOptions\fsc\checked

  • Source\CompilerOptions\fsc\cliversion

  • Source\CompilerOptions\fsc\codepage

  • Source\CompilerOptions\fsc\crossoptimize

  • Source\CompilerOptions\fsc\debug

  • Source\CompilerOptions\fsc\determinism

  • Source\CompilerOptions\fsc\dumpAllCommandLineOptions

  • Source\CompilerOptions\fsc\flaterrors

  • Source\CompilerOptions\fsc\gccerrors

  • Source\CompilerOptions\fsc\help

  • Source\CompilerOptions\fsc\highentropyva

  • Source\CompilerOptions\fsc\invalid

  • Source\CompilerOptions\fsc\langversion

  • Source\CompilerOptions\fsc\lib

  • Source\CompilerOptions\fsc\noframework

  • Source\CompilerOptions\fsc\nologo

  • Source\CompilerOptions\fsc\optimize

  • Source\CompilerOptions\fsc\out

  • Source\CompilerOptions\fsc\pdb

  • Source\CompilerOptions\fsc\platform

  • Source\CompilerOptions\fsc\reference

  • Source\CompilerOptions\fsc\Removed

  • Source\CompilerOptions\fsc\responsefile

  • Source\CompilerOptions\fsc\simpleresolution

  • Source\CompilerOptions\fsc\standalone

  • Source\CompilerOptions\fsc\staticlink

  • Source\CompilerOptions\fsc\subsystemversion

  • Source\CompilerOptions\fsc\tailcalls

  • Source\CompilerOptions\fsc\target

  • Source\CompilerOptions\fsc\times

  • Source\CompilerOptions\fsc\tokenize

  • Source\CompilerOptions\fsc\win32res

  • Source\CompilerOptions\fsc\determinism\PathMap1

  • Source\CompilerOptions\fsc\determinism\PathMap2

  • Source\CompilerOptions\fsc\lib\Folder1

  • Source\CompilerOptions\fsc\lib\Folder2

  • Source\CompilerOptions\fsc\lib\Folder3

  • Source\CompilerOptions\fsc\lib\Folder3\Folder3a

  • Source\CompilerOptions\fsi\arguments

  • Source\CompilerOptions\fsi\exename

  • Source\CompilerOptions\fsi\help

  • Source\CompilerOptions\fsi\highentropyva

  • Source\CompilerOptions\fsi\langversion

  • Source\CompilerOptions\fsi\nologo

  • Source\CompilerOptions\fsi\subsystemversion

  • Source\CompilerOptions\fsi\times

  • Source\Conformance\BasicGrammarElements

  • Source\Conformance\BasicTypeAndModuleDefinitions

  • Source\Conformance\DeclarationElements

  • Source\Conformance\Expressions

  • Source\Conformance\ImplementationFilesAndSignatureFiles

  • Source\Conformance\InferenceProcedures

  • Source\Conformance\LexicalAnalysis

  • Source\Conformance\LexicalFiltering

  • Source\Conformance\ObjectOrientedTypeDefinitions

  • Source\Conformance\PatternMatching

  • Source\Conformance\Signatures

  • Source\Conformance\SpecialAttributesAndTypes

  • Source\Conformance\StructFieldEqualityComparison

  • Source\Conformance\TypeForwarding

  • Source\Conformance\TypesAndTypeConstraints

  • Source\Conformance\UnitsOfMeasure

  • Source\Conformance\BasicGrammarElements\OperatorNames

  • Source\Conformance\BasicGrammarElements\PrecedenceAndOperators

  • Source\Conformance\BasicTypeAndModuleDefinitions\ExceptionDefinitions

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison

  • Source\Conformance\BasicTypeAndModuleDefinitions\ModuleDefinitions

  • Source\Conformance\BasicTypeAndModuleDefinitions\NamespaceDeclGroups

  • Source\Conformance\BasicTypeAndModuleDefinitions\NullRepresentations

  • Source\Conformance\BasicTypeAndModuleDefinitions\RecordTypes

  • Source\Conformance\BasicTypeAndModuleDefinitions\TypeAbbreviations

  • Source\Conformance\BasicTypeAndModuleDefinitions\UnionTypes

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Basic

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\IComparison

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\Diags

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\Legacy

  • Source\Conformance\BasicTypeAndModuleDefinitions\GeneratedEqualityHashingComparison\Attributes\New

  • Source\Conformance\DeclarationElements\AccessibilityAnnotations

  • Source\Conformance\DeclarationElements\CustomAttributes

  • Source\Conformance\DeclarationElements\Events

  • Source\Conformance\DeclarationElements\FieldMembers

  • Source\Conformance\DeclarationElements\ImportDeclarations

  • Source\Conformance\DeclarationElements\InterfaceSpecificationsAndImplementations

  • Source\Conformance\DeclarationElements\LetBindings

  • Source\Conformance\DeclarationElements\MemberDefinitions

  • Source\Conformance\DeclarationElements\ModuleAbbreviations

  • Source\Conformance\DeclarationElements\ObjectConstructors

  • Source\Conformance\DeclarationElements\P-invokeDeclarations

  • Source\Conformance\DeclarationElements\AccessibilityAnnotations\basic

  • Source\Conformance\DeclarationElements\AccessibilityAnnotations\OnOverridesAndIFaceImpl

  • Source\Conformance\DeclarationElements\AccessibilityAnnotations\OnTypeMembers

  • Source\Conformance\DeclarationElements\AccessibilityAnnotations\PermittedLocations

  • Source\Conformance\DeclarationElements\CustomAttributes\ArgumentsOfAllTypes

  • Source\Conformance\DeclarationElements\CustomAttributes\AttributeInheritance

  • Source\Conformance\DeclarationElements\CustomAttributes\AttributeUsage

  • Source\Conformance\DeclarationElements\CustomAttributes\Basic

  • Source\Conformance\DeclarationElements\CustomAttributes\ImportedAttributes

  • Source\Conformance\DeclarationElements\CustomAttributes\ArgumentsOfAllTypes\Generator

  • Source\Conformance\DeclarationElements\Events\basic

  • Source\Conformance\DeclarationElements\LetBindings\ActivePatternBindings

  • Source\Conformance\DeclarationElements\LetBindings\Basic

  • Source\Conformance\DeclarationElements\LetBindings\ExplicitTypeParameters

  • Source\Conformance\DeclarationElements\LetBindings\TypeFunctions

  • Source\Conformance\DeclarationElements\MemberDefinitions\ImplementingDispatchSlots

  • Source\Conformance\DeclarationElements\MemberDefinitions\MethodsAndProperties

  • Source\Conformance\DeclarationElements\MemberDefinitions\NamedArguments

  • Source\Conformance\DeclarationElements\MemberDefinitions\OptionalArguments

  • Source\Conformance\DeclarationElements\MemberDefinitions\OptionalDefaultParameterValueArguments

  • Source\Conformance\DeclarationElements\MemberDefinitions\OverloadingMembers

  • Source\Conformance\Expressions\ApplicationExpressions

  • Source\Conformance\Expressions\BindingExpressions

  • Source\Conformance\Expressions\ConstantExpressions

  • Source\Conformance\Expressions\ControlFlowExpressions

  • Source\Conformance\Expressions\DataExpressions

  • Source\Conformance\Expressions\ElaborationAndElaboratedExpressions

  • Source\Conformance\Expressions\EvaluationAndValues

  • Source\Conformance\Expressions\EvaluationOfElaboratedForms

  • Source\Conformance\Expressions\ExpressionQuotations

  • Source\Conformance\Expressions\SomeCheckingAndInferenceTerminology

  • Source\Conformance\Expressions\SyntacticSugar

  • Source\Conformance\Expressions\SyntacticSugarAndAmbiguities

  • Source\Conformance\Expressions\Type-relatedExpressions

  • Source\Conformance\Expressions\ApplicationExpressions\Assertion

  • Source\Conformance\Expressions\ApplicationExpressions\BasicApplication

  • Source\Conformance\Expressions\ApplicationExpressions\ObjectConstruction

  • Source\Conformance\Expressions\BindingExpressions\Binding

  • Source\Conformance\Expressions\ControlFlowExpressions\Assertion

  • Source\Conformance\Expressions\ControlFlowExpressions\Conditional

  • Source\Conformance\Expressions\ControlFlowExpressions\ParenthesizedAndBlock

  • Source\Conformance\Expressions\ControlFlowExpressions\PatternMatching

  • Source\Conformance\Expressions\ControlFlowExpressions\SequenceIteration

  • Source\Conformance\Expressions\ControlFlowExpressions\SequentialExecution

  • Source\Conformance\Expressions\ControlFlowExpressions\SimpleFor

  • Source\Conformance\Expressions\ControlFlowExpressions\TryFinally

  • Source\Conformance\Expressions\ControlFlowExpressions\TryWith

  • Source\Conformance\Expressions\ControlFlowExpressions\While

  • Source\Conformance\Expressions\DataExpressions\AddressOf

  • Source\Conformance\Expressions\DataExpressions\ComputationExpressions

  • Source\Conformance\Expressions\DataExpressions\NameOf

  • Source\Conformance\Expressions\DataExpressions\ObjectExpressions

  • Source\Conformance\Expressions\DataExpressions\QueryExpressions

  • Source\Conformance\Expressions\DataExpressions\RangeExpressions

  • Source\Conformance\Expressions\DataExpressions\SequenceExpressions

  • Source\Conformance\Expressions\DataExpressions\Simple

  • Source\Conformance\Expressions\DataExpressions\TupleExpressions

  • Source\Conformance\Expressions\DataExpressions\SequenceExpressions\version46

  • Source\Conformance\Expressions\DataExpressions\SequenceExpressions\version47

  • Source\Conformance\Expressions\ExpressionQuotations\Baselines

  • Source\Conformance\Expressions\ExpressionQuotations\Regressions

  • Source\Conformance\ImplementationFilesAndSignatureFiles\CheckingOfImplementationFiles

  • Source\Conformance\ImplementationFilesAndSignatureFiles\InitializationSemanticsForImplementationFiles

  • Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles

  • Source\Conformance\ImplementationFilesAndSignatureFiles\SignatureFiles

  • Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles\basic

  • Source\Conformance\ImplementationFilesAndSignatureFiles\NamespacesFragmentsAndImplementationFiles\global

  • Source\Conformance\InferenceProcedures\ByrefSafetyAnalysis

  • Source\Conformance\InferenceProcedures\ConstraintSolving

  • Source\Conformance\InferenceProcedures\DispatchSlotChecking

  • Source\Conformance\InferenceProcedures\DispatchSlotInference

  • Source\Conformance\InferenceProcedures\FunctionApplicationResolution

  • Source\Conformance\InferenceProcedures\Generalization

  • Source\Conformance\InferenceProcedures\MethodApplicationResolution

  • Source\Conformance\InferenceProcedures\NameResolution

  • Source\Conformance\InferenceProcedures\RecursiveSafetyAnalysis

  • Source\Conformance\InferenceProcedures\ResolvingApplicationExpressions

  • Source\Conformance\InferenceProcedures\TypeInference

  • Source\Conformance\InferenceProcedures\WellFormednessChecking

  • Source\Conformance\InferenceProcedures\NameResolution\AutoOpen

  • Source\Conformance\InferenceProcedures\NameResolution\Misc

  • Source\Conformance\InferenceProcedures\NameResolution\RequireQualifiedAccess

  • Source\Conformance\LexicalAnalysis\Comments

  • Source\Conformance\LexicalAnalysis\ConditionalCompilation

  • Source\Conformance\LexicalAnalysis\Directives

  • Source\Conformance\LexicalAnalysis\HiddenTokens

  • Source\Conformance\LexicalAnalysis\IdentifierReplacements

  • Source\Conformance\LexicalAnalysis\IdentifiersAndKeywords

  • Source\Conformance\LexicalAnalysis\LineDirectives

  • Source\Conformance\LexicalAnalysis\NumericLiterals

  • Source\Conformance\LexicalAnalysis\Shift

  • Source\Conformance\LexicalAnalysis\StringsAndCharacters

  • Source\Conformance\LexicalAnalysis\SymbolicKeywords

  • Source\Conformance\LexicalAnalysis\SymbolicOperators

  • Source\Conformance\LexicalAnalysis\Whitespace

  • Source\Conformance\LexicalAnalysis\Shift\Generics

  • Source\Conformance\LexicalFiltering\Basic

  • Source\Conformance\LexicalFiltering\HashLight

  • Source\Conformance\LexicalFiltering\HighPrecedenceApplication

  • Source\Conformance\LexicalFiltering\LexicalAnalysisOfTypeApplications

  • Source\Conformance\LexicalFiltering\Basic\ByExample

  • Source\Conformance\LexicalFiltering\Basic\OffsideExceptions

  • Source\Conformance\ObjectOrientedTypeDefinitions\AbstractMembers

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes

  • Source\Conformance\ObjectOrientedTypeDefinitions\DelegateTypes

  • Source\Conformance\ObjectOrientedTypeDefinitions\EnumTypes

  • Source\Conformance\ObjectOrientedTypeDefinitions\InterfaceTypes

  • Source\Conformance\ObjectOrientedTypeDefinitions\StructTypes

  • Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions

  • Source\Conformance\ObjectOrientedTypeDefinitions\TypeKindInference

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\AsDeclarations

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\AutoProperties

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ExplicitFields

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ExplicitObjectConstructors

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ImplicitObjectConstructors

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\InheritsDeclarations

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\LetDoDeclarations

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\MemberDeclarations

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\Misc

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\StaticLetDoDeclarations

  • Source\Conformance\ObjectOrientedTypeDefinitions\ClassTypes\ValueRestriction

  • Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\basic

  • Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\intrinsic

  • Source\Conformance\ObjectOrientedTypeDefinitions\TypeExtensions\optional

  • Source\Conformance\PatternMatching\And

  • Source\Conformance\PatternMatching\Array

  • Source\Conformance\PatternMatching\As

  • Source\Conformance\PatternMatching\ConsList

  • Source\Conformance\PatternMatching\DynamicTypeTest

  • Source\Conformance\PatternMatching\Expression

  • Source\Conformance\PatternMatching\Named

  • Source\Conformance\PatternMatching\Null

  • Source\Conformance\PatternMatching\Record

  • Source\Conformance\PatternMatching\Simple

  • Source\Conformance\PatternMatching\SimpleConstant

  • Source\Conformance\PatternMatching\Tuple

  • Source\Conformance\PatternMatching\TypeAnnotated

  • Source\Conformance\PatternMatching\TypeConstraint

  • Source\Conformance\PatternMatching\Union

  • Source\Conformance\PatternMatching\Wildcard

  • Source\Conformance\Signatures\SignatureConformance

  • Source\Conformance\Signatures\SignatureTypes

  • Source\Conformance\SpecialAttributesAndTypes\Imported

  • Source\Conformance\SpecialAttributesAndTypes\Imported\CallerInfo

  • Source\Conformance\SpecialAttributesAndTypes\Imported\System.ThreadStatic

  • Source\Conformance\TypeForwarding\Class

  • Source\Conformance\TypeForwarding\Cycle

  • Source\Conformance\TypeForwarding\Delegate

  • Source\Conformance\TypeForwarding\Interface

  • Source\Conformance\TypeForwarding\Nested

  • Source\Conformance\TypeForwarding\Struct

  • Source\Conformance\TypesAndTypeConstraints\CheckingSyntacticTypes

  • Source\Conformance\TypesAndTypeConstraints\LogicalPropertiesOfTypes

  • Source\Conformance\TypesAndTypeConstraints\TypeConstraints

  • Source\Conformance\TypesAndTypeConstraints\TypeParameterDefinitions

  • Source\Conformance\UnitsOfMeasure\Basic

  • Source\Conformance\UnitsOfMeasure\Bounds

  • Source\Conformance\UnitsOfMeasure\Constants

  • Source\Conformance\UnitsOfMeasure\Diagnostics

  • Source\Conformance\UnitsOfMeasure\Operators

  • Source\Conformance\UnitsOfMeasure\Parenthesis

  • Source\Conformance\UnitsOfMeasure\Parsing

  • Source\Conformance\UnitsOfMeasure\TypeChecker

  • Source\Conformance\UnitsOfMeasure\WithOOP

  • Source\Diagnostics\async

  • Source\Diagnostics\General

  • Source\Diagnostics\NONTERM

  • Source\Diagnostics\ParsingAtEOF

  • Source\InteractiveSession\Misc

  • Source\InteractiveSession\Misc\aaa

  • Source\InteractiveSession\Misc\ccc

  • Source\InteractiveSession\Misc\GenericConstraintWoes

  • Source\InteractiveSession\Misc\ScriptTest

  • Source\InteractiveSession\Misc\UnknownDependencyManager

  • Source\InteractiveSession\Misc\aaa\bbb

  • Source\InteractiveSession\Misc\GenericConstraintWoes\issue2411

  • Source\Libraries\Core

  • Source\Libraries\Portable

  • Source\Libraries\Core\NativeInterop

  • Source\Libraries\Core\PartialTrust

  • Source\Libraries\Core\NativeInterop\stackalloc

  • Source\Misc\test

  • Source\Optimizations\AssemblyBoundary

  • Source\Optimizations\ForLoop

  • Source\Optimizations\GenericComparison

  • Source\Optimizations\Inlining

  • [ ]

Metadata

Metadata

Assignees

No one assigned

    Labels

    PlanTracking

    Type

    No type

    Projects

    F# Compiler and Tooling

    Status

    New

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions