#Zj6! dZddlZddlZddlmZmZerddlmZdZdZ de e efde e effd Z d e d e d e de e effd Z dZdZGddZdS)a Functionality to convert tabular data in Frictionless Data Packages to CSVW. We translate [table schemas](https://specs.frictionlessdata.io/table-schema/) defined for [data resources](https://specs.frictionlessdata.io/data-resource/) in a [data package](https://specs.frictionlessdata.io/data-package/) to a CVSW TableGroup. This functionality can be used together with the `frictionless describe` command to add CSVW metadata to "raw" CSV tables. N)Any TYPE_CHECKING) TableGroupcddi}ddkr dr d|d<ddkrLdr7dr"dd d dd |d<dd vrqd d urtdtfddDr0i|d<dD](}|r||d|<)|S)Nbasetypestringformat dc:formatboolean trueValues falseValuesr|)numberinteger bareNumberTzbareNumber is not supported in CSVW. It may be possible to translate to a number pattern, though. See https://www.w3.org/TR/2015/REC-tabular-data-model-20151217/#formats-for-numeric-typesc3 K|]}|vV dSN).0propspecs ]/Users/jameslopez/projects/MentorCore/.venv/lib/python3.11/site-packages/csvw/frictionless.py z,_convert_numeric_datatype.. s'EEtt|EEEEEE) decimalChar groupChar)getNotImplementedErrorany)rdatatypeps` r_convert_numeric_datatyper#sFV %H F|xDHHX$6$6 $X F|y  TXXl%;%; @W@W $\ 21 5PP]8KA8NPP F|,,, 88L ! !T ) )%-.. . EEEE(DEEE E E 4!#HX 1 4 488A;;4,0GHX&q) Orcfddd}d|vr|ddkr|ddkrddiS|ddkr|dd krdd iS|d|vrd||diS|dd vrt|S|dd vrd ddS|ddkrd ddSddiS)NgYear gYearMonth)year yearmonthrr r binaryrurianyURI)r rrr datetimedatetimeduration)objectarrayjsonzapplication/json)rr geojsonzapplication/geo+json)rr#)rtypemaps r_convert_datatyper5(s!G~~ <8 # #(:(:h(F(FH% % <8 # #(:(:e(C(CH% % <7 " "GDL12 2 <   -T22 2 <. . ."1CDD D <9 $ $"1GHH H H rrreturnc`|dt|d}d|dfD}|r||d<d|vr |dg|d<d|vr |d|d <|d i}d D]6}||vr|||d |<d |vrd|d vr|d |d d<7|S)zj https://specs.frictionlessdata.io/table-schema/#field-descriptors :param spec: :return: name)r8r!cg|]}||Srr)rts r z'convert_column_spec..Hs 2 2 2A 2a 2 2 2rtitletitles descriptiondc:descriptionrdfType propertyUrl constraints)required minLength maxLengthminimummaximumr!patternr )r5r)rresr=rBrs rconvert_column_specrJ?s<->t-D-D E EC 2 2$((7++, 2 2 2F H !%m!4 5 D!)_M((="--KL?? ;  $/$5C OD !  $ $83z?+J+J(3I(>C OH % Jrrsc_namefk resource_mapc^|d|dd||ddp|ddS)zF https://specs.frictionlessdata.io/table-schema/#foreign-keys fields referenceresource)columnReferencerQ)rRrPr)rKrLrMs rconvert_foreignKeyrS[sFh<!+x8$R _Z%@%LHM    rcdd|dDi}dD]L}t|tr|\}}n|}||vr)||||<|dkrfd||D||<M|S)a :param rsc_name: `name` property of the resource the schema belongs to. Needed to resolve self-referential foreign keys. :param schema: `dict` parsed from JSON representing a frictionless Table Schema object. :param resource_map: `dict` mapping resource names to resource paths, needed to convert foreign key constraints. :return: `dict` suitable for instantiating a `csvw.metadata.Schema` object. columnsc,g|]}t|Sr)rJ)rfs rr;z(convert_table_schema..ts!HHH!*1--HHHrrO)) missingValuesnull primaryKey foreignKeysr[c2g|]}t|Sr)rS)rrLrMrKs rr;z(convert_table_schema..s'dddRT1(B MMdddr) isinstancetuple)rKschemarMrIrtoprops` ` rconvert_table_schemaraks HHvh7GHHH IC e e dE " " LD&&F 6>> ,CK}$$dddddX[\bXcdddF Jrc|di}d|vr|d}i}|dr |d|d<|dr |d|d<dD]}||vr ||||<d|vr |d|d<|S)zk Limitations: lineTerminator is not supported. https://specs.frictionlessdata.io/csv-dialect/ dialectcsv delimiterencoding)re quoteChar doubleQuoteskipInitialSpaceheader commentChar commentPrefix)r)rscdrIrs rconvert_dialectros  2A zz eH Cuu[*[>K wwz*j/J   199$CI /O Jrc*eZdZdZddZdeddfdZdS) DataPackagez6 Metadata according to the frictionless spec. Nct|tr|j|_|j|_dSt|trt j|pd|_nt|t jr7|p|j|_tj| d}n/tj|}t j|pd|_||_dS)N.utf8)rf) r]rqr2dirdictpathlibPathparentloads read_text)selfr directorys r__init__zDataPackage.__init__s dK ( (  DIxDH F dD ! ! 6|I$455DHH gl + + 6 /DKDH:dnnfn==>>DD:d##D|I$455DH rclsr6rcddi}tj|j|d<dD]\}}||jvr|j|||<d|jvr3d|jvr|jd|d<nd|jvr|jd|d <d |jd gD}d |D}|D]}|d }|r|ddkr|ddkrl|dg|dt |d||t |d} |d| ||} |jdz | _ | S)Nz@contextzhttp://www.w3.org/ns/csvwz dc:replaces) )id dc:identifier)licensesz dc:license)r<dc:title)homepagezdcat:accessURL)r>r?)sourcesz dc:source) contributorszdc:contributor)profilez dc:conformsTo)keywordsz dc:subject)createdz dc:createdr8rrr<rcg|]}d|v| S)pathrrrms rr;z-DataPackage.to_tablegroup..sTTTSfPSmmSmmmr resourcesc4i|]}d|v|d|dS)r8rrrs r z-DataPackage.to_tablegroup..s(WWWSSVF S[rr_schemefiler rdtablesr)url tableSchemarczcsvw-metadata.json) r2dumpsr setdefaultraroappend fromvalueru_fname) r|rmdflpropcsvwproprrMrmr_tablerIs r to_tablegroupzDataPackage.to_tablegroups(*EF Jty11= ! 1 1 FH""#y08 TY  49$$&*i&7?## ))!%6!2:UTDIMM+r$B$BTTT WWIWWW  + +CWWX&&F +GGH%%//GGH%%.. h+++v;#7Q]#^#^.s33 8 ##E***mmBX 44  rr)__name__ __module__ __qualname____doc__r~rrrrrrqrqsT"00,000000rrq)rr2rwtypingrr csvw.metadatarr#r5rvstrrJrSrarorqrrrrs;   %%%%%%%%)((((((*.d38nc3h8   /3 8