δm
d Z ddlZddlZddlZddlZddlZddlZddlZ G d d Z G d d Z i Z
G d d Z G d d
Z G d d Z
G d
d Z G d dee e e e
e Zd ZdS )a Provides the `CCompilerOpt` class, used for handling the CPU/hardware
optimization, starting from parsing the command arguments, to managing the
relation between the CPU baseline and dispatch-able features,
also generating the required C headers and ending with compiling
the sources with proper compiler's flags.
`CCompilerOpt` doesn't provide runtime detection for the CPU features,
instead only focuses on the compiler side, but it creates abstract C headers
that can be used later for the final runtime dispatching process. Nc
e Zd ZdZdZdZdZdZej
ej ej e
d Zi ZdZdZ e eddd
eddd
ed dd
ed
dd
eddd
eddd
Z eddddddd Z edzi d edd d d ed dd ! d" ed#d d$! d% ed&d"d'! d( ed)d%d*! d+ ed,d(d-! d. ed/d+0 d1 ed2d.d3d4 d5 ed6d1d7! d8 ed9d1d7! d: ed;d10 d< ed=d:0 d> ed?d:0 d@ edAdBddCD dE edFd@0 dG edHdEdIdGdJ dK edLdGdMdKdJ dN edOdEdPdNddQR dS edTdNdUdSV dW edXdNdYdWdJ dZ ed[d\d]dZdJ d^ ed_dZd`d^dJ da eddbdcd de ed dadf dg ed#dedf dh ed&dgddiD dj eddkl dm ed djdf dn ed#dmdf do eddpl dq ed do0 dr ed#dq0 ds ed&dtdf du ed)ds0 dv ed,ds0 dw ed/du0 Zdx Zdy ZdS ){_Configa An abstract class holds all configurable attributes of `CCompilerOpt`,
these class attributes can be used to change the default behavior
of `CCompilerOpt` in order to fit other requirements.
Attributes
----------
conf_nocache : bool
Set True to disable memory and file cache.
Default is False.
conf_noopt : bool
Set True to forces the optimization to be disabled,
in this case `CCompilerOpt` tends to generate all
expected headers in order to 'not' break the build.
Default is False.
conf_cache_factors : list
Add extra factors to the primary caching factors. The caching factors
are utilized to determine if there are changes had happened that
requires to discard the cache and re-updating it. The primary factors
are the arguments of `CCompilerOpt` and `CCompiler`'s properties(type, flags, etc).
Default is list of two items, containing the time of last modification
of `ccompiler_opt` and value of attribute "conf_noopt"
conf_tmp_path : str,
The path of temporary directory. Default is auto-created
temporary directory via ``tempfile.mkdtemp()``.
conf_check_path : str
The path of testing files. Each added CPU feature must have a
**C** source file contains at least one intrinsic or instruction that
related to this feature, so it can be tested against the compiler.
Default is ``./distutils/checks``.
conf_target_groups : dict
Extra tokens that can be reached from dispatch-able sources through
the special mark ``@targets``. Default is an empty dictionary.
**Notes**:
- case-insensitive for tokens and group names
- sign '#' must stick in the begin of group name and only within ``@targets``
**Example**:
.. code-block:: console
$ "@targets #avx_group other_tokens" > group_inside.c
>>> CCompilerOpt.conf_target_groups["avx_group"] = \
"$werror $maxopt avx2 avx512f avx512_skx"
>>> cco = CCompilerOpt(cc_instance)
>>> cco.try_dispatch(["group_inside.c"])
conf_c_prefix : str
The prefix of public C definitions. Default is ``"NPY_"``.
conf_c_prefix_ : str
The prefix of internal C definitions. Default is ``"NPY__"``.
conf_cc_flags : dict
Nested dictionaries defining several compiler flags
that linked to some major functions, the main key
represent the compiler name and sub-keys represent
flags names. Default is already covers all supported
**C** compilers.
Sub-keys explained as follows:
"native": str or None
used by argument option `native`, to detect the current
machine support via the compiler.
"werror": str or None
utilized to treat warning as errors during testing CPU features
against the compiler and also for target's policy `$werror`
via dispatch-able sources.
"maxopt": str or None
utilized for target's policy '$maxopt' and the value should
contains the maximum acceptable optimization by the compiler.
e.g. in gcc `'-O3'`
**Notes**:
* case-sensitive for compiler names and flags
* use space to separate multiple flags
* any flag will tested against the compiler and it will skipped
if it's not applicable.
conf_min_features : dict
A dictionary defines the used CPU features for
argument option `'min'`, the key represent the CPU architecture
name e.g. `'x86'`. Default values provide the best effort
on wide range of users platforms.
**Note**: case-sensitive for architecture names.
conf_features : dict
Nested dictionaries used for identifying the CPU features.
the primary key is represented as a feature name or group name
that gathers several features. Default values covers all
supported features but without the major options like "flags",
these undefined options handle it by method `conf_features_partial()`.
Default value is covers almost all CPU features for *X86*, *IBM/Power64*
and *ARM 7/8*.
Sub-keys explained as follows:
"implies" : str or list, optional,
List of CPU feature names to be implied by it,
the feature name must be defined within `conf_features`.
Default is None.
"flags": str or list, optional
List of compiler flags. Default is None.
"detect": str or list, optional
List of CPU feature names that required to be detected
in runtime. By default, its the feature name or features
in "group" if its specified.
"implies_detect": bool, optional
If True, all "detect" of implied features will be combined.
Default is True. see `feature_detect()`.
"group": str or list, optional
Same as "implies" but doesn't require the feature name to be
defined within `conf_features`.
"interest": int, required
a key for sorting CPU features
"headers": str or list, optional
intrinsics C header file
"disable": str, optional
force disable feature, the string value should contains the
reason of disabling.
"autovec": bool or None, optional
True or False to declare that CPU feature can be auto-vectorized
by the compiler.
By default(None), treated as True if the feature contains at
least one applicable flag. see `feature_can_autovec()`
"extra_checks": str or list, optional
Extra test case names for the CPU feature that need to be tested
against the compiler.
Each test case must have a C file named ``extra_xxxx.c``, where
``xxxx`` is the case name in lower case, under 'conf_check_path'.
It should contain at least one intrinsic or function related to the test case.
If the compiler able to successfully compile the C file then `CCompilerOpt`
will add a C ``#define`` for it into the main dispatch header, e.g.
``#define {conf_c_prefix}_XXXX`` where ``XXXX`` is the case name in upper case.
**NOTES**:
* space can be used as separator with options that supports "str or list"
* case-sensitive for all values and feature name must be in upper-case.
* if flags aren't applicable, its will skipped rather than disable the
CPU feature
* the CPU feature will disabled if the compiler fail to compile
the test file
FNchecksNPY_NPY__z
-march=nativez-O3z-Werror)nativeoptwerrorz-Werror=switch -Werrorz-xHostz/QxHostz/O3z/Werrorz/O2z/WXz -mcpu=a64fx)gccclangicciccwmsvcfcczSSE SSE2z
SSE SSE2 SSE3 zVSX VSX2z NEON NEON_FP16 NEON_VFPV4 ASIMD)x86x64ppc64ppc64les390xarmhfaarch64SSE z xmmintrin.hSSE2)interestheadersimplies z emmintrin.h)r r r SSE3 z pmmintrin.hSSSE3 z tmmintrin.hSSE41 z smmintrin.hPOPCNT zpopcntintrin.hSSE42 )r r AVX z immintrin.h)r r r implies_detectXOP z x86intrin.hFMA4
F16C FMA3 AVX2
AVX512F z FMA3 AVX2AVX512F_REDUCE)r r r, extra_checksAVX512CD
AVX512_KNL( zAVX512ER AVX512PF)r r groupdetectr,
AVX512_KNM) z)AVX5124FMAPS AVX5124VNNIW AVX512VPOPCNTDQ
AVX512_SKX* zAVX512VL AVX512BW AVX512DQzAVX512BW_MASK AVX512DQ_MASK)r r r? r@ r, r:
AVX512_CLX+
AVX512VNNI)r r r? r@
AVX512_CNL, zAVX512IFMA AVX512VBMI
AVX512_ICL- zAVX512_CLX AVX512_CNLz(AVX512VBMI2 AVX512BITALG AVX512VPOPCNTDQ
AVX512_SPR.
AVX512FP16VSXz altivec.hVSX_ASM)r r r: VSX2)r r r, VSX3VSX4VSX4_MMAVXz vecintrin.h)r r VXEVXE2NEONz
arm_neon.h NEON_FP16
NEON_VFPV4ASIMDzNEON_FP16 NEON_VFPV4ASIMDHPASIMDDPASIMDFHMc p | j ri S | j p| j }| j p
| j p| j }|r|rt
dwi dt
d dt
d dt
d dt
d d
t
d d t
d
dt
d dt
d dt
d dt
d dt
d dt
d dt
d d t
d d t
d d t
d! d"t
d# d$t
d% d&t
d' d(t
d) d*t
d+ d,t
d- S |rp| j rht
dwi dt
d dt
d dt
d dt
d d
t
d d i dt
d dt
d di dt
d./ dt
d./ dt
d0d12 dt
dd12 d t
d3d42 d t
d5d42 d t
d6 d"t
d7 d$t
d8 d&t
d9 d(t
d: d*t
d; d,t
d dt
d? dt
d@ d
t
dA d i dt
dB dt
dC di dt
d./ dt
d./ dt
d0dD2 dt
ddD2 d t
d3dE2 d t
d5dE2 d t
dF d"t
dG d$t
dH d&t
dI d(t
dJ d*t
dK d,t
d ni di di d
i d t
dLM di dt
dC di dt
dNM dt
dNM dt
d0dO2 dt
dPdO2 d t
dQdR2 d t
dSdR2 d t
dT/ d"t
dT/ d$t
dR d&i d(i d*i d,t
dT/ S | j
p| j }|rt
t
| j
rdUndVdW2 t
dXdYZ t
d[dYZ t
d\dYZ ] }| j r,d^|d_ d`< dX|dU d`< da|db d`< dc|dd d`< |S | j }|r@t
t
de t
dfdYZ t
dgdYZ h }|S | j
r~|r|t
t
didjk t
dldjk t
dmdjk t
dndjk t
do t
dp t
dq r S | j rz|rxt
t
ds t
dt t
du t
dv t
do t
dp t
dq r S i S )xa7 Return a dictionary of supported CPU features by the platform,
and accumulate the rest of undefined options in `conf_features`,
the returned dict has same rules and notes in
class attribute `conf_features`, also its override
any options that been set in 'conf_features'.
r z-msse)flagsr z-msse2r z-msse3r" z-mssse3r$ z-msse4.1r& z-mpopcntr( z-msse4.2r* z-mavxr1 z-mf16cr- z-mxopr/ z-mfma4r3 z-mfmar5 z-mavx2r7 z-mavx512f -mno-mmxr; z
-mavx512cdr= z-mavx512er -mavx512pfrA z/-mavx5124fmaps -mavx5124vnniw -mavx512vpopcntdqrC z -mavx512vl -mavx512bw -mavx512dqrE z -mavx512vnnirH z-mavx512ifma -mavx512vbmirJ z.-mavx512vbmi2 -mavx512bitalg -mavx512vpopcntdqrL z -mavx512fp16z!Intel Compiler doesn't support it)disablez F16C AVX2z-march=core-avx2)r r` z
AVX2 AVX512CDz-march=common-avx512z AVX2 AVX512Fz-xKNLz-xKNMz-xSKYLAKE-AVX512z
-xCASCADELAKEz -xCANNONLAKEz-xICELAKE-CLIENTzNot supported yetz /arch:SSEz
/arch:SSE2z
/arch:SSE3z /arch:SSSE3z /arch:SSE4.1z /arch:SSE4.2z /arch:AVXz/arch:CORE-AVX2z/Qx:COMMON-AVX512z/Qx:KNLz/Qx:KNMz/Qx:SKYLAKE-AVX512z/Qx:CASCADELAKEz/Qx:CANNONLAKEz/Qx:ICELAKE-CLIENTz nmmintrin.h)r z ammintrin.hz
/arch:AVX2z F16C FMA3zAVX2 AVX512CD AVX512_SKXz /arch:AVX512zAVX512F AVX512_SKXz MSVC compiler doesn't support itrQ r z-mvsxz -mcpu=power8F)r` r, z-mcpu=power9 -mtune=power9z -mcpu=power10 -mtune=power10)rO rQ rR rS z-maltivec -mvsxrO r` z -mcpu=power9rR z
-mcpu=power10rS z-march=arch11 -mzvectorz
-march=arch12z
-march=arch13)rU rV rW zNEON_FP16 NEON_VFPV4 ASIMDT)r autoveczNEON NEON_VFPV4 ASIMDzNEON NEON_FP16 ASIMDzNEON NEON_FP16 NEON_VFPV4z-march=armv8.2-a+fp16z-march=armv8.2-a+dotprodz-march=armv8.2-a+fp16fml)rX rY rZ r[ r\ r] r^ z
-mfpu=neonz"-mfpu=neon-fp16 -mfp16-format=ieeez-mfpu=neon-vfpv4z'-mfpu=neon-fp-armv8 -march=armv8-a+simd )cc_noopt cc_on_x86 cc_on_x64 cc_is_gcc cc_is_clang cc_is_fccdict cc_is_icc
cc_is_iccw
cc_is_msvc
cc_on_ppc64le cc_on_ppc64 cc_on_s390x
cc_on_aarch64 cc_on_armhf)selfon_x86is_unixon_powerpartialon_zarchs q/builddir/build/BUILD/cloudlinux-venv-1.0.10/venv/lib64/python3.11/site-packages/numpy/distutils/ccompiler_opt.pyconf_features_partialz _Config.conf_features_partialI sT = I 14>.FD$4F
g
d '
'
'
(((('
))))'
))))'
**** '
++++ '
++++
'
++++'
(((('
))))'
(((('
))))'
(((('
))))'
!56666 '
,//// '
$;<<< $89999?!/
@ &9::::A!/
!(
D (
do (
d (/
(/
(/
-1^C$[))))(/
/3~E4l++++2(/
R(/
R (/
R (/
-0000
(/
R(/
,,,,(/
R(/
-0000(/
-0000(/
#< (/
#< !(/
* 2. +(/
0 ,N 1(/
6 : 7(/
< : =(/
B N3333C(/
D E(/
F G(/
H I(/
J : K(/
((
T %9)9 '+'9 AVVr! ( 6u 8 G
;+<w'+9(+9(+:(N#
3 )% )%
G N
'
$4d / . 3T - 0 0 '3
3
3
,
.
" : ( ? - 0 0 '1
1
1
*
0 c | j =dd ldd l}| fd}t j | | _ | j 2t j t | j g| _ d S d S )Nr c V d S # t $ r Y d S w xY wN)rmtreeOSError)shutiltmps ry rm_tempz!_Config.__init__..rm_temp? sB MM#&&&&& DDs
(()
conf_tmp_pathr tempfilemkdtempatexitregisterconf_cache_factorsospathgetmtime__file__ conf_nocache)rs r r r r s @@ry __init__z_Config.__init__: s % MMM OOO""$$C
OG $ $ $!$D " * **!'D # # # + *r{ rc )__name__
__module__ __qualname____doc__r
conf_nooptr r r r joindirnamerealpathr conf_check_pathconf_target_groups
conf_c_prefixconf_c_prefix_rj
conf_cc_flagsconf_min_features
conf_featuresrz r rc r{ ry r r s ` `B LJ Mgll
((2233X O M NDd %
$ .
d
t
t
d"
C& & &MN 3 D Y Y Yd
Y q% GGGGY q&-HHHHY q&-HHHHY q'=IIIIY q';KLLLLY q(3333Y
Y$ q% GGGG%Y& r5-HHHH'Y( r51111)Y* r62222+Y, r62222-Y. $U)
/Y6 4Y77777Y8 T3F
9Y@ T =
AYJ T3O 6
KYT T \
UY\ T 5L
]Yd T!8<
eYn T \
oYz dA{KKKK{Y~ tQeDDDDYB tQuEEEECYF tQu!+- - - -GYN T1m
4
4
4
4OYR dAtEBBBBSYV tQeDDDDWYZ a 6666[Y\ D!V4444]Y` T1k::::aYd a)?PUVVVVeYh $73333iYl $73333mYp 4I6666qYMto o ob r{ r c e Zd ZdZd ZddZg fdZd Zed Z ed Z
ed d
d Z ed Z ed
Z
ddZ ej d Zedd ZdS )
_Distutilsa A helper class that provides a collection of fundamental methods
implemented in a top of Python and NumPy Distutils.
The idea behind this class is to gather all methods that it may
need to override in case of reuse 'CCompilerOpt' in environment
different than of what NumPy has.
Parameters
----------
ccompiler : `CCompiler`
The generate instance that returned from `distutils.ccompiler.new_compiler()`.
c || _ d S r~ )
_ccompiler)rs ccompilers ry r z_Distutils.__init__Z s
#r{ Nc t |t sJ t |t sJ | dg |z }|s| j } |j |fd|i|S )zWrap CCompiler.compile()extra_postargs)
isinstancelistpopr compile)rs sourcesr` r kwargss ry dist_compilez_Distutils.dist_compile] sv '4(())(%&&''&
+R0058 ( I y III&IIIr{ c t |t sJ ddlm} | j }t |dd }|rGt | j dd }|dv rt
|d| j nt
|d| j d} | |g||| j
d
}n6# |$ r.} | t | d
Y d} ~ nd} ~ ww xY w|rt
|d| |S ) zgReturn True if 'CCompiler.compile()' able to compile
a source file with certain flags.
r CompileErrorspawnN
compiler_typer )r F)macros
output_dirTstderr) r strdistutils.errorsr r getattrsetattr_dist_test_spawn_paths_dist_test_spawnr r dist_log)
rs sourcer` r r ccbk_spawncc_typetestes
ry dist_testz_Distutils.dist_testg s> &#&&''&111111
_2w-- < doCCG)##GT%@AAAAGT%:;;; / %4;M
DD / / / MM#a&&M . . . . . . . . / + B * * * s !B$ $C)$CCc | t | d r| j S t | j dd }|dv rd}n|dv rd}ndd lm} | }t | j d
t | j d d }|r|d k r)t |d
r |d }nt
| }n|}t |d
r1t | dk r d |dd }nCt j
dd }|t j
dd z
}|||f| _ | j S )a!
Return a tuple containing info about (platform, compiler, extra_args),
required by the abstract class '_CCompiler' for discovering the
platform environment. This is also used as a cache factor in order
to detect any changes happening from outside.
_dist_infor r )intelemintelemwx86_64)intelintelwinteler r ) get_platformcompiler compiler_sounix__iter__r NCFLAGSCPPFLAGS) hasattrr r r distutils.utilr r lenr r environget)rs r platformr cc_infor
extra_argss ry dist_infoz_Distutils.dist_info sZ 4 & & #? "$/?B?? - - - HH
5
5
5 HH 3 3 3 3 3 3#|~~H$/:wtP]_a7b7bcc 'V++w
++
("1: w<< H 7J ' ' 9CLL1,<,< '!""+..JJ *..266J "*..R88 8J#Xz: r{ c < ddl m} |t j | )zRaise a compiler errorr r )r r r _dist_str)argsr s ry
dist_errorz_Distutils.dist_error s. 211111l:/6777r{ c < ddl m} |t j | )zRaise a distutils errorr )DistutilsError)r r r r )r r s ry
dist_fatalz_Distutils.dist_fatal s. 433333 nZ 14 8999r{ Fr c ddl m} t j | }| r| | dS | | dS )zPrint a console messager )logN)numpy.distutilsr r r warninfo)r r r outs ry r z_Distutils.dist_log sQ ('''''"D) HHSMMMMM HHSMMMMMr{ c ddl m} || | S # t $ r&}t |d Y d}~nd}~ww xY wdS )zALoad a module from file, required by the abstract class '_Cache'.r )exec_mod_from_locationTr N) misc_utilr Exceptionr r )namer r r s ry dist_load_modulez_Distutils.dist_load_module sz 655555 0))$55 5 0 0 0 $ / / / / / / / / 0ts
A ?Ac fdt j d }d|j |j fz }d fdg | R D }||z S )z+Return a string to print by log and errors.c t | t sPt | d r@g }| D ] }| | !dd | z dz S t | S )Nr (r ))r r r appendr )argretato_strs ry r z$_Distutils._dist_str..to_str s| c3''
0GC,D,D
0 * *AJJvvayy))))CHHSMM)C//s88Or{ r zCCompilerOpt.%s[%d] : r c & g | ]
} | S rc rc ).0r r s ry
z(_Distutils._dist_str.. s1
F1II
r{ )inspectstackfunctionlinenor )r r startr r s @ry r z_Distutils._dist_str s
"(ENEL+IIhh
tXX
s{r{ c * t | j d s| | dS t j d } | j j t j d< | | |t j d< dS # |t j d< w xY w)z
Fix msvc SDK ENV path same as distutils do
without it we get c1: fatal error C1356: unable to find mspdbcore.dll
_pathsNr )r r r r getenvr r )rs cmddisplayold_paths ry r z!_Distutils._dist_test_spawn_paths s
t11 ! !# & & & F9V$$ *!% !7BJv ! !# & & &!)BJv BJv ) ) ) )s .B Bz/.*(warning D9002|invalid argument for option).*c t j | t j d }|r>t j t
j | r t
d| d|z d S # t j $ r}|j }|j
}Y d }~n d }~wt $ r}|}d}Y d }~nd }~ww xY wt
d| d||fz d S )NT)r textzFlags in commandz/aren't supported by the compiler, output ->
%s Commandz(failed with exit status %d output ->
%s)
subprocess check_outputSTDOUTrematchr _dist_warn_regexr CalledProcessErroroutput
returncoder )r r oexcsr s ry r z_Distutils._dist_test_spawn s 'J4E-13 3 3A
RXj 91==
%%& .')*.+ 4 ,
AAAAAAA AAAAAAA
s G
qK
s$ A!A% %B"4B
B"B B"r~ )r r r r r r r r staticmethodr r r r r r r r r r rc r{ ry r r M sQ $ $ $J J J J /1 4# # # J 8 8 \8
: : \:
$ \ \ \$
*
*
*
* "rz \ r{ r c b e Zd ZdZ ej d Zd dZd Zd Z d Z
e d Z dS )
_Cachea' An abstract class handles caching functionality, provides two
levels of caching, in-memory by share instances attributes among
each other and by store attributes into files.
**Note**:
any attributes that start with ``_`` or ``conf_`` will be ignored.
Parameters
----------
cache_path : str or None
The path of cache file, if None then cache in file will disabled.
*factors :
The caching factors that need to utilize next to `conf_cache_factors`.
Attributes
----------
cache_private : set
Hold the attributes that need be skipped from "in-memory cache".
cache_infile : bool
Utilized during initializing this class, to determine if the cache was able
to loaded from the specified cache path in 'cache_path'.
z
^(_|conf_)Nc h i | _ t | _ d| _ d | _ | j r| d d S | j g || j R | _ || _ |rt j | r| d| |
d| }|s| dd nt |d rt |d s| d
d nr| j |j k rM| d |j D ]\ }}t% | || d| _ n| d | j st& | j }|ri| d
|j D ]:\ }}||j v st- j | j | r)t% | || ;| t& | j < t3 j | j d S )NFz cache is disabled by `Config`zload cache from file ->cachez)unable to load the cache file as a moduleTr hashdatazinvalid cache filezhit the file cachezmiss the file cachezhit the memory cache) cache_meset
cache_private cache_infile _cache_pathr r
cache_hashr _cache_hashr r existsr r r r itemsr _share_cacher __dict__r r
_cache_ignorer r cache_flush)rs
cache_pathfactors cache_modattrval other_caches ry r z_Cache.__init__% s`
UU ! MM9 : : : F*4?NGNd6MNNN% 9w~~j))
9
7DDD 1 1': F F 9MMC # " !F33 9 F33 9MM"6tMDDDD% 77MM"6777%.^%9%9%;%; 1 1 c dC0000(,D%%MM"7888 -&**4+;<T)compactwz # AUTOGENERATED DON'T EDIT
# Please make changes to the code generator (distutils/ccompiler_opt.py)
hash = {}
data = \
)r" r r( copykeysr r r) r r r r r% makedirspprintpformatopenwritetextwrapdedentformatr$ )rs cdictr. d repr_dictfs ry r* z_Cache.cache_flushX s F
.0@AAA
""$$M&&(( Dx*D11
$ GOOD , - -w~~a KNNNN5$777
$"C
(
( A
GGHO % ())
+
+
+
GGI s AE--E14E1c ~ d}|D ]7}t | D ]%}t | |dz z |dz z |z
}|dz }&8|S )Nr r' l )r ord)rs r, chashrD chars ry r# z_Cache.cache_hasht sg $ $AA
$
$ Teqj1Ub[AEI#
$ r{ c fd}|S )zr
A static method that can be treated as a decorator to
dynamically cache certain methods.
c t j g|| | R }|| j v r
| j | S | g|R i |}|| j |< |S r~ )r r r8 valuesr )rs r r cache_keyccbcbs ry
cache_wrap_mez _Cache.me..cache_wrap_me s " %+[[]] 5;]]__ I DM))}Y//"T+D+++F++C'*DM) $Jr{ rc )rO rP s ` ry mez _Cache.me~ s$ r{ r~ )
r r r r r r r) r r3 r* r# r rQ rc r{ ry r r s 4 BJ|,,M+* +* +* +*Z 8 \ r{ r c . e Zd ZdZd Zej d Zej g fd Zd Z e
j d Z e
j d Z
e
j d Z e
j d Zd
Z e
j d Z e
j d Zd
ZdS )
_CCompilera2 A helper class for `CCompilerOpt` containing all utilities that
related to the fundamental compiler's functions.
Attributes
----------
cc_on_x86 : bool
True when the target architecture is 32-bit x86
cc_on_x64 : bool
True when the target architecture is 64-bit x86
cc_on_ppc64 : bool
True when the target architecture is 64-bit big-endian powerpc
cc_on_ppc64le : bool
True when the target architecture is 64-bit litle-endian powerpc
cc_on_s390x : bool
True when the target architecture is IBM/ZARCH on linux
cc_on_armhf : bool
True when the target architecture is 32-bit ARMv7+
cc_on_aarch64 : bool
True when the target architecture is 64-bit Armv8-a+
cc_on_noarch : bool
True when the target architecture is unknown or not supported
cc_is_gcc : bool
True if the compiler is GNU or
if the compiler is unknown
cc_is_clang : bool
True if the compiler is Clang
cc_is_icc : bool
True if the compiler is Intel compiler (unix like)
cc_is_iccw : bool
True if the compiler is Intel compiler (msvc like)
cc_is_nocc : bool
True if the compiler isn't supported directly,
Note: that cause a fail-back to gcc
cc_has_debug : bool
True if the compiler has debug flags
cc_has_native : bool
True if the compiler has native flags
cc_noopt : bool
True if the compiler has definition 'DISABLE_OPT*',
or 'cc_on_noarch' is True
cc_march : str
The target architecture name, or "unknown" if
the architecture isn't supported
cc_name : str
The compiler name, or "unknown" if the compiler isn't supported
cc_flags : dict
Dictionary containing the initialized flags of `_Config.conf_cc_flags`
c L t | d rd S d}d}d}| }|\ }}}|||fD ] }|D ]\ } }
} t | | d ||f||ffD ]Z\ } }
| D ]R\ } }
} |
r!t j |
|
t j s)| r| | sAt | | d [|D ]R\ } }
} |
r!t j |
|t j s)| r| | sAt | | d S| j r"| d| dd d| _ | j
r | d
d d| _ | j r# | d | dd d| _ d | _
d
D ] }t | d|z r || _
n d | _ dD ] }t | d|z r || _ n i | _ | j | j }| | d| j z | D ]n\ }}g x| j |< }|r[t+ |t, sJ | }|D ]-}| |g r| | .od| _ d S )N cc_is_cached))rf z.*(x|x86_|amd)64.*r )re z.*(win32|x86|i386|i686).*r )rn z&.*(powerpc|ppc)64(el|le).*|.*powerpc.*z4defined(__powerpc64__) && defined(__LITTLE_ENDIAN__))ro z .*(powerpc|ppc).*|.*powerpc.*z1defined(__powerpc64__) && defined(__BIG_ENDIAN__))rq z.*(aarch64|arm64).*r )rr z.*arm.*z3defined(__ARM_ARCH_7__) || defined(__ARM_ARCH_7A__))rp z .*s390x.*r ) cc_on_noarchr r ))rg z.*(gcc|gnu\-g).*r )rh z .*clang.*r )rl z.*(intelw|intelemw|iccw).*r )rk z.*(intel|icc).*r )rm z.*msvc.*r )ri z.*fcc.*r )
cc_is_noccr r )) cc_has_debugz$.*(O0|Od|ggdb|coverage|debug:full).*r )
cc_has_nativez..*(-march=native|-xHost|/QxHost|-mcpu=a64fx).*r )rd z.*DISABLE_OPT.*r FTz]unable to detect CPU architecture which lead to disable the optimization. check dist_info:<<
z
>>r z&Optimization is disabled by the Configzunable to detect compiler type which leads to treating it as GCC. this is a normal behavior if you're using gcc-like compiler such as MinGW or IBM/XLC.check dist_info:<<
unknown)r r r r r r r cc_on_)r r r r
r r cc_is_z=undefined flag for compiler '%s', leave an empty dict instead)r r r r r
IGNORECASE
cc_test_cexprrV r rd r rW rg cc_marchr cc_namecc_flagsr r r r& r r split
cc_test_flagsr rU )rs detect_archdetect_compiler detect_argsr r
compiler_infor sectionr. rgexcexprr@ searchinarchr compiler_flagsr` nflagsrD s ry r z_CCompiler.__init__ s 4 ( ( F
NN$$ .7+-#_kB + +G%,
+
+!dEdE****
+ #.x!8?M:Z [ FH%+
!dE x G G !3!3E!:!: dD)))!, & & D$
BHT:r} E E
T / / 6 6
D$ % % % % ! MM7'07 7 7
!DM ? ! MMB4M P P P DM ? "
MM7'07 7 7
"DN!
2 DtX_--
$
! B DtX_--
#
+// == ! OO.04 =
*//11 ) )KD%+- -DM$ &
)!%--..-
) )A))1#.. )
a((( r{ c t |t sJ | d| t j | j d }| || }|s| dd |S )z@
Returns True if the compiler supports 'flags'.
z
testing flagsz test_flags.ctesting failedTr )r r r r r r r r )rs r` test_pathr s ry rc z_CCompiler.cc_test_flags7 s}
%&&''&
ou---GLL!5~FF ~~i// 9 MM*4M 8 8 8 r{ c | d| t j | j d }t |d 5 }| t j d| d ddd n # 1 swxY w Y | || }|s| dd |S )
zJ
Same as the above but supports compile-time expressions.
ztesting compiler expressionznpy_dist_test_cexpr.cr6 z #if !(zq)
#error "unsupported expression"
#endif
int dummy;
Nrp Tr )
r r r r r r< r= r> r? r )rs rj r` rq fdr s ry r^ z_CCompiler.cc_test_cexprD s
3U;;;GLL!35LMM
)S
!
! R HHX_ && & &
~~i// 9 MM*4M 8 8 8 s ,BB Bc t |t sJ | j s| j s| j r| | S | j s| j r| | S |S )a
Remove the conflicts that caused due gathering implied features flags.
Parameters
----------
'flags' list, compiler flags
flags should be sorted from the lowest to the highest interest.
Returns
-------
list, filtered from any conflicts.
Examples
--------
>>> self.cc_normalize_flags(['-march=armv8.2-a+fp16', '-march=armv8.2-a+dotprod'])
['armv8.2-a+fp16+dotprod']
>>> self.cc_normalize_flags(
['-msse', '-msse2', '-msse3', '-mssse3', '-msse4.1', '-msse4.2', '-mavx', '-march=core-avx2']
)
['-march=core-avx2']
) r r rg rh rk _cc_normalize_unixrm rl _cc_normalize_win)rs r` s ry cc_normalize_flagsz _CCompiler.cc_normalize_flagsW sw . %&&''& > 2T - 2 2**511 1 ? 1do 1))%00 0 r{ z ^(-mcpu=|-march=|-x[A-Z0-9\-])zB^(?!(-mcpu=|-march=|-x[A-Z0-9\-]|-m[a-z0-9\-\.]*.$))|(?:-mzvector)z^(-mfpu|-mtune)z[0-9.]c fd}t | dk r|S t t | D ]\ }}t j j | s |d |dz }|| d }t
t j j | } || \ }} }
|dk rMt |
dk r:|D ] } || \ } }
}|| k r||
z }
| dz d
|
z }||gz }|dk r||z
} g }t }t | D ][}t j j | }|sn&|d |v r*|
|d | d| \|S )Nc
| d }t dd t j j |d z }||d |dd fS )N+0r r r )rb floatr r findall_cc_normalize_arch_ver)rD tokensverrs s ry ver_flagsz0_CCompiler._cc_normalize_unix..ver_flags sk WWS\\Fbgg
46q BB C q 6!"":- -r{ r r rz )r enumeratereversedr r _cc_normalize_unix_mrgxr filter_cc_normalize_unix_frgxsearchr r _cc_normalize_unix_krgxaddinsert)rs r` r icur_flag lower_flags upper_flagsfilteredr rl subflagsxflagxver_ xsubflags final_flagsmatchedrD r s ` ry ru z _CCompiler._cc_normalize_unix s . . . . . u::??L$Xe__55 KAx8D 8(CC
1Q3.K *KF,3[ H #,)H"5"5 CxQww3x==1,, ( 8 8E)25)9)9&D!Yd{{#,x#7 #:(:(:: z)E1uu$ %%% % %AHT 91==E
&qW$$ E!H%%% q! $ $ $ $r{ z^(?!(/arch\:|/Qx\:))z
^(/arch|/Qx:)c t t | D ]b\ }}t j | j | s |dz
}t t
| j j |d | || d z c S |S )Nr ) r r r r _cc_normalize_win_mrgxr r _cc_normalize_win_frgxr )rs r` r rD s ry rv z _CCompiler._cc_normalize_win s huoo.. DAq8D 7;;
FA+2E#A2#J rss
r{ N)r r r r r r rQ rc r^ rw r r r r r r~ ru r r rv rc r{ ry rS rS s: / /`t! t! t!l Y
Y
Y)+ Y$ > )bj) )bj )bj (RZ / / /b (RZ (RZ r{ rS c e Zd ZdZd Zddg fdZd ZddZddZd Z d
Z
d Z d Z d
Z
ej d Zej dg fd Zej dg fd Zej d Zej d ZddZdS )_Featurea A helper class for `CCompilerOpt` that managing CPU features.
Attributes
----------
feature_supported : dict
Dictionary containing all CPU features that supported
by the platform, according to the specified values in attribute
`_Config.conf_features` and `_Config.conf_features_partial()`
feature_min : set
The minimum support of CPU features, according to
the specified values in attribute `_Config.conf_min_features`.
c b t | d rd S | x| _ }t | D ]}|| | j | } fd| D d }|1| | |
d|z |d dD ]C} | }t |t r|
|< Dt | _ | j | j d }|
D ]%}|| j v r| j | &d| _ d S ) Nfeature_is_cachedc $ i | ] \ }}|v ||
S rc rc )r kvfeatures ry
z%_Feature.__init__.. s0 !1G3C3C!3C3C3Cr{ ra zfeature '%s' is disabled,Tr )r r? r@ r r` r: r )r rz feature_supportedr r8 r updater& r r r r r rb r feature_minr r_ upperr r )
rs pfeatures feature_namecfeaturedisabledoptionovalmin_fFr s
@ry r z_Feature.__init__ s 4, - - F-1-G-G-I-II !1!1 2 2 3 3L .G),7H NN '~~ / /
{{9--H#
l+++
/,> T
3
3 {{6** dC(( 3&*jjllGFO
3 55&**4="== $$&& ( (AD*** $$Q'''!% r{ Nc @ |'t |t st |d sJ |t |t sJ || j }t
}|D ]/}| ||| r| | 0|S )a
Returns a set of CPU feature names that supported by platform and the **C** compiler.
Parameters
----------
names : sequence or None, optional
Specify certain CPU features to test it against the **C** compiler.
if None(default), it will test all current supported features.
**Note**: feature names must be in upper-case.
force_flags : list or None, optional
If None(default), default compiler flags for every CPU feature will
be used during the test.
macros : list of tuples, optional
A list of C macro definitions.
Nr force_flagsr ) r r r r r r8 r feature_is_supportedr )rs namesr r supported_namesrD s ry
feature_namesz_Feature.feature_names s &
M uc**
z**
M
"jd&C&C""C =*//11E %% ' 'A(({6 )
' ##A&&& r{ c @ | sJ || j v S )z
Returns True if a certain feature is exist and covered within
`_Config.conf_features`.
Parameters
----------
'name': str
feature name in uppercase.
)isupperr )rs r s ry feature_is_existz_Feature.feature_is_exist s% ||~~ ~t)))r{ Fc 2 fd}t ||| S )az
Sort a list of CPU features ordered by the lowest interest.
Parameters
----------
'names': sequence
sequence of supported feature names in uppercase.
'reverse': bool, optional
If true, the sorted features is reversed. (highest interest)
Returns
-------
list, sorted CPU features
c t | t rj | d S t fd| D }|t | dz
z
}|S )Nr c 6 g | ]}j | d S )r )r r rD rs s ry r z<_Feature.feature_sorted..sort_cb..< s& III!.q1*=IIIr{ r )r r r maxr )r rankrs s ry sort_cbz(_Feature.feature_sorted..sort_cb8 se !S!!
=-a0<<IIIIqIIIJJD
CFFAI DKr{ )reversekey)sorted)rs r r r s ` ry feature_sortedz_Feature.feature_sorted) s3 eW'::::r{ c . t f fd t |t r | }|g}nCt |d sJ t }|D ] }| | }!|s| | |S )a
Return a set of CPU features that implied by 'names'
Parameters
----------
names : str or sequence of str
CPU feature name(s) in uppercase.
keep_origins : bool
if False(default) then the returned set will not contain any
features from 'names'. This case happens only when two features
imply each other.
Examples
--------
>>> self.feature_implies("SSE3")
{'SSE', 'SSE2'}
>>> self.feature_implies("SSE2")
{'SSE'}
>>> self.feature_implies("SSE2", keep_origins=True)
# 'SSE2' found here since 'SSE' and 'SSE2' imply each other
{'SSE', 'SSE2'}
c t }j | }| dg D ]P}| | ||v r | | | || }Q|S )Nr )r r r r union)r _callerr rB r get_impliesrs s ry r z-_Feature.feature_implies..get_implies[ s eeG&t,AUU9b))
A
A A<< D!!!!-- Aw(?(?@@Nr{ r )r r r r r difference_update)rs r keep_originsr nr s ` @ry feature_impliesz_Feature.feature_impliesC s 0 '*ee eS ! ! 8!k%((GGEE5*-- . .-eeG
8
8!-- A77 - % %e , , ,r{ c t |t rt |f }nt | }| | | S )z/same as feature_implies() but combining 'names')r r r r r )rs r s ry feature_implies_cz_Feature.feature_implies_ct sN eS ! ! MMEEJJE{{4//66777r{ c t |t st |d sJ | |d fd|D }t | dk r | |d dd }|S ) a
Return list of features in 'names' after remove any
implied features and keep the origins.
Parameters
----------
'names': sequence
sequence of CPU feature names in uppercase.
Returns
-------
list of CPU features sorted as-is 'names'
Examples
--------
>>> self.feature_ahead(["SSE2", "SSE3", "SSE41"])
["SSE41"]
# assume AVX2 and FMA3 implies each other and AVX2
# is the highest interest
>>> self.feature_ahead(["SSE2", "SSE3", "SSE41", "AVX2", "FMA3"])
["AVX2"]
# assume AVX2 and FMA3 don't implies each other
>>> self.feature_ahead(["SSE2", "SSE3", "SSE41", "AVX2", "FMA3"])
["AVX2", "FMA3"]
r T)r c g | ]}|v| S rc rc )r r r s ry r z*_Feature.feature_ahead.. s# 666qQg%5%5%5%5%5r{ r r Nr )r r r r r r )rs r aheadr s @ry
feature_aheadz_Feature.feature_ahead| s 6 5#&&
z**
+ &&u4&@@6666E666 u::?? ''t'<>> self.feature_untied(["SSE2", "SSE3", "SSE41"])
["SSE2", "SSE3", "SSE41"]
# assume AVX2 and FMA3 implies each other
>>> self.feature_untied(["SSE2", "SSE3", "SSE41", "FMA3", "AVX2"])
["SSE2", "SSE3", "SSE41", "AVX2"]
r c J g | ] }|v | v | S rc )r )r nnr r rs s ry r z+_Feature.feature_untied.. sD ==Q$*>*>r*B*B%B%B %B%B%Br{ r Nr )r r r r r remover )rs r finaltiedr r s ` @@ry feature_untiedz_Feature.feature_untied s . 5#&&
z**
+ A**1--G " D
***41#:66DH$$ T"1"Xa[))) LLOOOO r{ c fdt |t st | dk r! | }| |S | }fd|D } | S )z
same as `feature_implies_c()` but stop collecting implied
features when feature's option that provided through
parameter 'keyisfalse' is False, also sorting the returned
features.
c | } | d } t | D ]5\ }}j | d s| d |dz } n6| S )NTr r )r r r r r )tnamesr r
keyisfalsers s ry tilz%_Feature.feature_get_til..til s ++F33F(((>>F!&))
1-a044ZFF #DQqSD\FE Mr{ r c 0 h | ]} | D ]}|S rc rc )r r tr s ry z+_Feature.feature_get_til.. s. 222q33q6622a2222r{ )r r r r r r )rs r r r s ` `@ry feature_get_tilz_Feature.feature_get_til s eS ! ! SZZ1__CJJE MMOOOL""5))2222E222""5)))r{ c | |d }g }|D ]=}| j | }|| d| d|g z
}>|S )z
Return a list of CPU features that required to be detected
sorted from the lowest to highest interest.
r, r@ r? )r r r )rs r r@ r rB s ry feature_detectz_Feature.feature_detect sj
$$U,<== ; ;A&q)A aeeHaeeGaS&9&9:: :FF
r{ c
| | | }g }|D ]B}| j | }| dg }|r| | s=||z
}C| | S )zi
Return a list of CPU features flags sorted from the lowest
to highest interest.
r` )r r r r rc rw )rs r r` r rB rD s ry
feature_flagsz_Feature.feature_flags s ##D$:$:5$A$ABB A&q)Agr""A
D . .q 1 1
QJEE&&u---r{ c || | }| d|dd | d t j | j d| z }t j | s| d| | ||| j
d z | }|s| d
d |S )
a
Test a certain CPU feature against the compiler through its own
check file.
Parameters
----------
name : str
Supported CPU feature name.
force_flags : list or None, optional
If None(default), the returned flags from `feature_flags()`
will be used.
macros : list of tuples, optional
A list of C macro definitions.
Nztesting feature 'z' with flags (r r zcpu_%s.cz feature test file is not existr
r rp Tr ) r r r r r r lowerr% r r ra )rs r r r rq r s ry feature_testz_Feature.feature_test s $ ,,T22K
DD#((;''''
GLL *tzz||";
w~~i(( I OO .P s6 ,-""A3'' r{ r` )r r r r any)rs r rB can valid_flagss ` ry feature_can_autovecz _Feature.feature_can_autovecG s
$$$%%$ "4 (eeIt$$ ; 12w1C1C K 2#k"2"2C
r{ c t |t sJ | j | }| dg }|sg S | d|z | | | }g }g }|D ]}t j | j d|
z }t j | s| d| |
||| j d z } | r| | | | |r| d|d |S ) z
Return a list of supported extra checks after testing them against
the compiler.
Parameters
----------
names : str
CPU feature name in uppercase.
r: z%Testing extra checks for feature '%s'z
extra_%s.cz extra check file does not existr
ztesting failed for checksTr )r r r r r r r r r r r r% r r ra r )
rs r rB r: r` available
not_availablechkrq is_supporteds
ry feature_extra_checksz _Feature.feature_extra_checksV sb $$$$$$ "4 (uu^R00 I
=DlSSS""4((
* *C $lSYY[[&@ I 7>>),,
N A9MMM >>)UT]8=T5TUUL
* %%%% $$S)))) S MM5}TM R R Rr{ r c | sJ | j | }|J d|z d| j d|dg}|d | dg D z
}| dg }|| | z
}|D ]!}|d | j d|d
| j d|dd gz
}"d k rfd
|D }d | S )a"
Generate C preprocessor definitions and include headers of a CPU feature.
Parameters
----------
'feature_name': str
CPU feature name in uppercase.
'tabs': int
if > 0, align the generated strings to the right depend on number of tabs.
Returns
-------
str, generated C preprocessor
Examples
--------
>>> self.feature_c_preprocessor("SSE3")
/** SSE3 **/
#define NPY_HAVE_SSE3 1
#include
Nz
/** %s **/z#define HAVE_z 1c g | ]}d |z S )z
#include <%s>rc )r r2 s ry r z3_Feature.feature_c_preprocessor.. s*
$%Oa
r{ r r? z#ifndef z #define z#endifr c g | ]
}d z |z S ) rc )r ltabss ry r z3_Feature.feature_c_preprocessor.. s! 444d4i1_444r{
)r r r r r r )rs r r r prepr
extra_defsedefs ` ry feature_c_preprocessorz _Feature.feature_c_preprocessor} sS , ##%%&&%(,,\::"""
< ' '%)%7%7%7 F
)0Y)C)C
[["--
d// ===
D
E'+'9'9'944@@+/+=+=+=tttD
EE !884444e444Eyy r{ F)r )r r r r r r r r r r r r r r r rQ r r r r r r rc r{ ry r r s & & &D #'D ! ! ! ! F * * *; ; ; ;4/ / / /b8 8 8$ $ $L' ' 'R* * *6
Y
.
. Y
. Y-1" % % % Y%N Y59" Y8 Y Y Y# # Y#L/ / / / / / r{ r c e Zd ZdZd Zd Z ej d Zd Z ej d Z
d Z d Z d Z
d
Zd Zd Zd
Zd Zd Zd ZdS )_Parsea A helper class that parsing main arguments of `CCompilerOpt`,
also parsing configuration statements in dispatch-able sources.
Parameters
----------
cpu_baseline : str or None
minimal set of required CPU features or special options.
cpu_dispatch : str or None
dispatched set of additional CPU features or special options.
Special options can be:
- **MIN**: Enables the minimum CPU features that utilized via `_Config.conf_min_features`
- **MAX**: Enables all supported CPU features by the Compiler and platform.
- **NATIVE**: Enables all CPU features that supported by the current machine.
- **NONE**: Enables nothing
- **Operand +/-**: remove or add features, useful with options **MAX**, **MIN** and **NATIVE**.
NOTE: operand + is only added for nominal reason.
NOTES:
- Case-insensitive among all CPU features and special options.
- Comma or space can be used as a separator.
- If the CPU feature is not supported by the user platform or compiler,
it will be skipped rather than raising a fatal error.
- Any specified CPU features to 'cpu_dispatch' will be skipped if its part of CPU baseline features
- 'cpu_baseline' force enables implied features.
Attributes
----------
parse_baseline_names : list
Final CPU baseline's feature names(sorted from low to high)
parse_baseline_flags : list
Compiler flags of baseline features
parse_dispatch_names : list
Final CPU dispatch-able feature names(sorted from low to high)
parse_target_groups : dict
Dictionary containing initialized target groups that configured
through class attribute `conf_target_groups`.
The key is represent the group name and value is a tuple
contains three items :
- bool, True if group has the 'baseline' option.
- list, list of CPU features.
- list, list of extra compiler flags.
c t d j g f j j g f j d g f j d g f j d dgf _ t d rd S g _ g _
g _ i _ j
rd x}} d |r d| } | } | _
| _ d | d| } fd|D }| | } | _ t+ | d k r d
|d d j D ]y\ }} d
| | }|r| sdg g f j |< S | \ } }
} | |
| f j |< zd _ d S )NMAXOPT)
KEEP_BASELINE KEEP_SORTr WERRORAUTOVECparse_is_cachedzcheck requested baseline cpu_baselinez&check requested dispatch-able features cpu_dispatchc & h | ]
}|j v |S rc parse_baseline_namesr s ry r z"_Parse.__init__.. s1 D 555 555r{ r z
skip featureszsince its part of baselinezinitialize targets groupszparse target groupFT) rj _parse_policy_not_keepbase_parse_policy_keepsort_parse_policy_not_keepsort_parse_policy_maxopt_parse_policy_werror_parse_policy_autovec_parse_policiesr r parse_baseline_flagsparse_dispatch_namesparse_target_groupsrd r _parse_arg_featuresr r r r
differencer r r& r strip_parse_target_tokensr ) rs r r baseline_names
cpu_dispatch_conflict_baseline
group_namer
GROUP_NAME has_baselinefeatures extra_flagss ` ry r z_Parse.__init__ s # d5
+/ )4
)4
*D
'
0 4* + + F$&!$&!$&!#% = /*. .L<
0111 # 33NLQQL ! / / = =N(,(:(:>(J(JD %(,(;(;&&~66) )D %
>??? # 4 4^\ R RM ( L !. 8 8 F F (,(;(;""<00) )D % $%%))
#%68T
1222"&"9"?"?"A"A J MM.
; ; ;#))++J
2r8(4 ))&11
0L(K h 4D $Z 0 0 $ r{ c | d| t | 5 }d}d}d}d}d}d}t | D ]\ } }
| |k r| d ny|dk r.|
| }|dk rD|t | z
}||
z
}|
| }|dk r$|t | t |
z
z
} nddd n # 1 swxY w Y |dk r| d |z |dk r| d
|z ||| }| | S ) a
Fetch and parse configuration statements that required for
defining the targeted CPU features, statements should be declared
in the top of source in between **C** comment and start
with a special mark **@targets**.
Configuration statements are sort of keywords representing
CPU features names, group of statements and policies, combined
together to determine the required optimization.
Parameters
----------
source : str
the path of **C** source file.
Returns
-------
- bool, True if group has the 'baseline' option
- list, list of CPU features
- list, list of extra compiler flags
z!looking for '@targets' inside -> r i z@targetsz*/zreached the max of linesNz(expected to find '%s' within a C commentzexpected to end with '%s')r r< r r findr r# ) rs r rs r max_to_reach
start_with start_posend_withend_pos current_linelines ry
parse_targetsz_Parse.parse_targets/ s ,
96BBB
&\\ RF L#JIHG&/mm
" d <//OO$>???E ?? $ * 5 5I B Z 0I$ ))H--b==s6{{SYY 66GE !% , ?? OO F S T T T b== OO 7( B C C C ')*((000s B7C))C-0C-z \s|,|([+-])c t |t s| d|z t }t t d t
j | j | }d}|D ]L}|d dv r| |d |dk rd},|dk rd}5| }t }|d k rn|d
k r>| j
d } | s| |d | | d
g }n{|dk r| j
}n[|dk r| j }nM|| j v r| | n.| | s| |d|z |r| | }n| | }d}N|S )Nzexpected a string in '%s'Tr )#$zYtarget groups and policies aren't allowed from arguments, only from dispatch-able sourcesrz -FNONENATIVEr z-native option isn't supported by the compiler)DETECT_FEATURESr r MAXMINz&, '%s' isn't a known feature or option)r r r r r r r rb _parse_regex_argr ra r r r8 r r r r r! )
rs arg_name req_featuresfinal_featuresr r tokTOK features_tor s
ry r z_Parse._parse_arg_featuresf s ,,, D OO 7( B C C C fT28D,A<#P#PQQRR , , C1v## 6
czz czz ))++C %%Kf}} x0 OOHG # 0 0 &0F/G 1 " 4 9 9 ; ; " . $000 OOC(((( 0055 Ds J
H!/!5!5k!B!B!/!:!:;!G!GFF r{ z\s|[*,/]|([()])c ^ t |t sJ g }g }d}t }t }d }t t d t j | j | }|s| d |D ]!}| } |d }
|
dv r| d 9|
dk r@|| d |
| | |
dk r4|| d | | ||| \ }}}|
d
k r&|| d t }|
d k r|| d
|
| } | #|
t | n6t | dk r| d } | r| |vr| | d }v| dk r|| d d}||
| | | s| d| z | | j v p| | j v } | r| |vr| | |
| #|| d |r| d|d | | }t | D ]N}
| j |
\ }}}|D ]8}||v r| d|
d|d |
| 9O| j D ]@\ }
\ }}}d }|
|v r|}| d|
z n|}|s/ |||| \ }}}A|||fS )NFzexpected one token at leastr )rz r: ze+/- are 'not' allowed from target's groups or @targets, only from cpu_baseline and cpu_dispatch parmsr9 zCpolicies aren't allowed inside multi-target '()', only CPU featuresr8 zHtarget groups aren't allowed inside multi-target '()', only CPU featuresr z"unclosed multi-target, missing ')'r z$multi-target opener '(' wasn't foundr BASELINEz/baseline isn't allowed inside multi-target '()'Tzinvalid target name '%s'z skip targetsz.not part of baseline or dispatch-able featureszpolicy 'z' force enables ''zpolicy '%s' is ON)r r r r r r rb _parse_regex_targetr r r _parse_token_policy_parse_token_group_parse_multi_targettupler r r r r r r r r& )rs r
final_targetsr+ r) skippedpolicies multi_targetrD rE chtargets
is_enabledpr depsrB havenhavefuncs ry r# z_Parse._parse_target_tokens s &#&&''&
5555 fT28D,Df#M#MNNOO ; OO 9 : : : > ! > !C))++CQBZ D s +OO. T 5 5c : :;;;;s +OO.
''\=+VV 9 m[[s +OO$HIII "uu s 'OO$JKKK 22<@@?KKl 3 344447||q((")!* 67-#?#?%,,W555 # *$$#/ (YZZZ#'L + $$S))) ,,S11 FOO$>$DEEE 444 5444 -//%,,S111 C # OO @ A A A MM @
++M::
h A -a0JAq$
==
AAqqq Q
$(#7#=#=#?#? A eQDH}}
1A 56666
7;t m[8 8 4L- ]K77r{ c t | dk s|dd |d k r| d |dd }|| j vr0| d|z | j |S )zvalidate policy tokenr r- Nr z*'$' must stuck in the begin of policy namez6'%s' is an invalid policy name, available policies are)r r r r8 )rs tokens ry rK z_Parse._parse_token_policy s u::??eBCCjE!H 4 4 OO H I I Iabb , , , OOH5P$))++
r{ c t | dk s|dd |d k r| d |dd }| j |ddg f \ }}}|3| d|z dz | j |rd }fd
|D z
fd |D z
|fS ) zvalidate group tokenr r- Nr z)'#' must stuck in the begin of group nameFz&'%s' is an invalid target group name, zavailable target groups areTc g | ]}|v| S rc rc )r rD rO s ry r z-_Parse._parse_token_group..1 s# HHH-1G1G!1G1G1Gr{ c g | ]}|v| S rc rc )r rD r+ s ry r z-_Parse._parse_token_group..2 s# HHHa1K3G3G3G3G3Gr{ )r r r r r8 )rs r\ r) rO r+
ghas_baselinegtargets gextra_flagss `` ry rL z_Parse._parse_token_group s u::??eBCCjE!H 4 4 OO G H H Habb 040H0L0L E4$1
1
-
x OO85@-.(--//
LHHHHXHHHH
HHHH<HHHH ]K77r{ c L |s d t fd|D s d| t fd|D sdS | }|sdS | }t | }|S )z9validate multi targets that defined between parentheses()zempty multi-target '()'c : g | ]} | S rc )r r tarrs s ry r z._Parse._parse_multi_target..: s4
+.D ! !# & &
r{ z#invalid target name in multi-targetc 4 g | ]}|j v p|j v S rc )r r re s ry r z._Parse._parse_multi_target..> sC
t00 1t00
r{ N)r allr r rN )rs rT s ` ry rM z_Parse._parse_multi_target5 s 7 OO 5 6 6 6
29
L
OO A7 K K K
4$$W-- 4%%g....r{ c , g }|dd D ]j}d}t |t r
| j v }nt fd|D }|r*| | | | k|r d| |||fS )zskip all baseline featuresNFc " g | ] }|j v S rc r r s ry r z5_Parse._parse_policy_not_keepbase..W s1 22 r{ zskip baseline features)r r r rh r r r )rs r) rO r+ rP rf is_bases ` ry r z!_Parse._parse_policy_not_keepbaseN s # * *CG#s##
!::
*s### $$S))) = MM2G < < <]K77r{ c : | d|d |||fS )z$leave a notice that $keep_sort is onz/policy 'keep_sort' is on, dispatch-able targetszo
are 'not' sorted depend on the highest interest butas specified in the dispatch-able source or the extra group)r rs r) rO r+ s ry r z _Parse._parse_policy_keepsortd s3
=} OJ
]K77r{ c : | |d }|||fS )z%sorted depend on the highest interestTr )r rm s ry r z!_Parse._parse_policy_not_keepsortm s' ++M4+HH
]K77r{ c | j r| d nI| j r| d n,| j d }|s| dd n||z
}|||fS )z&append the compiler optimization flagsz3debug mode is detected, policy 'maxopt' is skipped.z5optimization is disabled, policy 'maxopt' is skipped.r zOcurrent compiler doesn't support optimization flags, policy 'maxopt' is skippedTr )rX r rd ra rs r) rO r+ r` s ry r z_Parse._parse_policy_maxoptr s % MMO P P P P
]
% MMQ R R R RM%(E
%
19=
u$ ]K77r{ c | j d }|s| dd n| d ||z
}|||fS )z#force warnings to treated as errorsr
zTcurrent compiler doesn't support werror flags, warnings will 'not' treated as errorsTr z'compiler warnings are treated as errors)ra r rp s ry r z_Parse._parse_policy_werror sj
h' ! MM8@D
MMC D D D 5 K]K77r{ c @ g }|dd D ]t}t |t r | }nt fd|D }|s*| | | | u|r d| |||fS )z=skip features that has no auto-vectorized support by compilerNc : g | ]} | S rc )r )r r rs s ry r z0_Parse._parse_policy_autovec.. s7 ,,Q// r{ z!skip non auto-vectorized features)r r r rh r r r )rs r) rO r+ rP rf r s ` ry r z _Parse._parse_policy_autovec s #
$
$C#s##
..s33
$ $$S)))s### H MM=w G G G]K77r{ N)r r r r r r6 r r r@ r rJ r# rK rL rM r r r r r r rc r{ ry r r s - -\P$ P$ P$d41 41 41l "rz.116 6 6 p %"*%788r8 r8 r8h
8 8 8, 28 8 8,8 8 88 8 8
8 8 8" 8 8 88 8 8 8 8r{ r c X e Zd ZdZddZd Zd Zd Zd Zdd
Z d Z
dd
Z ddZ ddZ
dS ) CCompilerOptz
A helper class for `CCompiler` aims to provide extra build options
to effectively control of compiler optimizations that are directly
related to CPU features.
minr Nc ` t | t | | t | || || t
| t | | j s | j r| d d}t | || || _ || _ t | di | _ | j d t# | d | _ d S )NzSnative flag is specified through environment variables. force cpu-baseline='native'r sources_status hit_cache)r r r r r rS r rd rY r r _requested_baseline_requested_dispatchr rx r r r ry )rs r r r r+ s ry r zCCompilerOpt.__init__ s D),,,j$..*:*:L,WWWD!!!$ } $!3 $ MM.
$LlL999 $0 #/ &d,,>s,C,C CDD%%eR0077@@@@
= kN :;;%%eR0077<<<(4g'>D $ $ %++-- KE4 (t(d5kk -6:@
GG r{ c d|z } }t | }t | }t j | }t j | s/ d| dd t j | t |d 5 }d
fd|D }d
fd |D } | t j
d
j d
| d
| |||| d
}
|D ] } |
| d dz z
}
d
} |D ]I} | t j
d j | | d z
} J| t j
d j |
| ddd dS # 1 swxY w Y dS )ax
Generate the dispatch header which contains the #definitions and headers
for platform-specific instruction-sets for the enabled CPU baseline and
dispatch-able features.
Its highly recommended to take a look at the generated header
also the generated source files via `try_dispatch()`
in order to get the full picture.
z"generate CPU dispatch header: (%s)zdispatch header dir z does not exist, creating itTr r6 \
c , g | ]}d j d|dS r z WITH_CPU_EXPAND_(MACRO_TO_CALL(, __VA_ARGS__))r r s ry r z9CCompilerOpt.generate_dispatch_header..M A + + + A ''',+ + +r{ c , g | ]}d j d|dS r r r s ry r z9CCompilerOpt.generate_dispatch_header..S r r{ a /*
* AUTOGENERATED DON'T EDIT
* Please make changes to the code generator (distutils/ccompiler_opt.py)
*/
#define {pfx}WITH_CPU_BASELINE "{baseline_str}"
#define {pfx}WITH_CPU_DISPATCH "{dispatch_str}"
#define {pfx}WITH_CPU_BASELINE_N {baseline_len}
#define {pfx}WITH_CPU_DISPATCH_N {dispatch_len}
#define {pfx}WITH_CPU_EXPAND_(X) X
#define {pfx}WITH_CPU_BASELINE_CALL(MACRO_TO_CALL, ...) \
{baseline_calls}
#define {pfx}WITH_CPU_DISPATCH_CALL(MACRO_TO_CALL, ...) \
{dispatch_calls}
r )pfx baseline_str dispatch_str baseline_len dispatch_lenbaseline_callsdispatch_callsr r )r r z #ifdef {pfx}CPU_TARGET_{name}
{pre}
#endif /*{pfx}CPU_TARGET_{name}*/
)r r prez /******* baseline features *******/
{baseline_pre}
/******* dispatch features *******/
{dispatch_pre}
)r baseline_pre dispatch_preN)r r r r r r r r% r9 r< r r= r> r? r@ r r r )
rs header_pathr$ dispatch_namesr r
header_dirrD r r r r r s
` ry generate_dispatch_headerz%CCompilerOpt.generate_dispatch_header3 s
:[HIII 0022 0022>** >** W__[11
w~~j)) $ MMOzOOO
K
# # #
+s
#
# 8 q $\\ + + + + ( + + + N %\\ + + + + ( + + + N
GGHO % &SXXn5M5M XXn 5 5L ). -
( L&
Q
Q ; ;Dq ; I ID PP L&
1 ! ! V +$D. s" 444'$CII444r{ c B g | ] \ }}|D ]\ }}t | S rc r )r r rowscols ry r z'CCompilerOpt.report.. s3 FFFDFFvsACHHFFFFr{ z z: r )r rV r_ rW r` rd reprrz r r r r r{ r rx r& r r r r r r r r r ) rs fullreport
platform_rows
baseline_rows
dispatch_rowsr$ r r: r r target_sourcesr r rT rf generatedr pretty_namer` r r@ r r secs_lencols_lentabpadsecr r r/ s ry r zCCompilerOpt.report s
z=1222
h
~}5666
h
~}5666 n ! . AMMDM
j !_ @KKDL
= P !G H H H H +tD4L/M/M!N O O O 0022 NN 000
0022 .Lchh~...f
" < 4I**>::
;
;(- (c 2 2Nss# 8NTGc'll$: :: +/Vy"~~PV!W X X X X !2 3 3 3**>::
4
4(-%/S%9%9 UccvQT
?U !3!3C!8!899 ((4#6#6t7K7KC7P7P#Q#QRR $"5"5c":":;; ! '1#s';'; DcVV D DD D$=$=d$C$CCLL:F R 6 6 6F $$X... $$k7%;<<< $$gu%5666 $$nl%CDDD $$h%7888" 4 4C!(("c33334
44V444FFFFFF3x==#h--00 4 4IC
B 3#C.) )C KKc D( ) ) )
4
4SscCHHn-- C#I ,s 23333
4 yy r{ c
t |t t f sJ t |t r|x}}n*d | }d | }t j |t j | } dj g t j | | R }|r!t j
| r|S | d| | |
| }d| j z fd|D } d | } t |d 5 }
|
t# j d | j |t j | |
d d d n # 1 swxY w Y |S ) N.__z
{0}.{2}{1}z wrap dispatch-able target -> z#define %sCPU_TARGET_c g | ]}|z S rc rc )r rD target_joins ry r z-CCompilerOpt._wrap_target..
s 9991{Q999r{ r r6 aR /**
* AUTOGENERATED DON'T EDIT
* Please make changes to the code generator (distutils/ccompiler_opt.py)
*/
#define {pfx}CPU_TARGET_MODE
#define {pfx}CPU_TARGET_CURRENT {target_name}
{target_defs}
#include "{path}"
)r target_namer target_defs)r r rN r r r basenamer@ splitextr r% r r r r r< r= r> r? abspath) rs r dispatch_srctargetr ext_namer wrap_pathr* r rs r s @ry r zCCompilerOpt._wrap_target s &3,//00/ fc " " ,%+ +H{{ xx''H ))F++KGLLRW-=-=l-K-KLL 'L'W)9)9))D)DWhnnFVFVWWW y11
5yAAA&&t'='=f'E'EFF-0CC 9999999 ii ,,
)S
!
! R HHX_
&
'[W__\22
s =A!G**G.1G.c
t j | }t j | d dz }t j || }| || } t
| 5 }| d }t | dk r't |d |k r d d d dS d d d n # 1 swxY w Y n# t $ r Y nw xY wt j t j
| d | d| g } |D ]}
t |
t r|
} n d d
|
D } | |
} d d | D } | d
| j d| d| d d | } |r d| j z }
nd}
t
|d 5 }| t+ j d | j |
| | d d d n # 1 swxY w Y dS )Nr z.hz cache_hash:r r T)exist_okz generate dispatched config -> r c g | ]}|S rc rc )r r s ry r z1CCompilerOpt._generate_config../
s (8(8(8q(8(8(8r{ z&&c g | ]}d |z S )zCHK(%s)rc )r rD s ry r z1CCompilerOpt._generate_config..1
s) $ $ $"# A
$ $ $r{ r zCPU_DISPATCH_EXPAND_(CB((z), r r z( %sCPU_DISPATCH_EXPAND_(CB(__VA_ARGS__))r r6 aZ // cache_hash:{cache_hash}
/**
* AUTOGENERATED DON'T EDIT
* Please make changes to the code generator (distutils/ccompiler_opt.py)
*/
#ifndef {pfx}CPU_DISPATCH_EXPAND_
#define {pfx}CPU_DISPATCH_EXPAND_(X) X
#endif
#undef {pfx}CPU_DISPATCH_BASELINE_CALL
#undef {pfx}CPU_DISPATCH_CALL
#define {pfx}CPU_DISPATCH_BASELINE_CALL(CB, ...) \
{baseline_calls}
#define {pfx}CPU_DISPATCH_CALL(CHK, CB, ...) \
{dispatch_calls}
)r r r r# F)r r r r r r# r< readlinerb r intr r9 r r r r r r r r= r> r? r@ )rs r r rT r) config_pathr# rD last_hashr rf r
req_detectr rs s ry r z CCompilerOpt._generate_config
sD g&&|44 g&&{33A6= gll:{;; __Wl;;
k""
a JJLL . .} = = y>>Q&&3y|+<+<
+J+J
D BGOOK004@@@@
6 DDD C#s##
: ! "ii(8(8C(8(8(8 9 9 ,,S11J $ $'1$ $ $ J
! ! !###ZZZ
! n55 ;# $NN N
+s
#
# r HHX_ & ' -*
( usP ?D AC<# D 0 D <D D D D
DD+AI;;I?I?)rv r N)NNr )r r r r r r~ r r r r r r r r rc r{ ry ru ru s
4 4 4 444 4 4 ) ) ) ) ) ) ) ) ) U U U UnQ Q Qfk k k k Z$ $ $ $L< < < < < <r{ ru c t | fi |}t j | r| s| | |S )a
Create a new instance of 'CCompilerOpt' and generate the dispatch header
which contains the #definitions and headers of platform-specific instruction-sets for
the enabled CPU baseline and dispatch-able features.
Parameters
----------
compiler : CCompiler instance
dispatch_hpath : str
path of the dispatch header
**kwargs: passed as-is to `CCompilerOpt(...)`
Returns
-------
new instance of CCompilerOpt
)ru r r r% r~ r )r dispatch_hpathr r s ry new_ccompiler_optr W
sW " x
*
*6
*
*C
7>>. ) ) 5 5 $$^444 Jr{ )r r r r r: r r r> r r r' r rS r r ru r rc r{ ry r s E E
x x x x x x x xtx x x x x x x x t F F F F F F F F Pw w w w w w w wr c c c c c c c c Jt8 t8 t8 t8 t8 t8 t8 t8lq q q q q7J
Hf q q qf
r{