8000 FEATURE: Ability to upload JSON files larger than 100MB · Issue #4189 · alephdata/aleph · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
FEATURE: Ability to upload JSON files larger than 100MB #4189
Open
@mingfang

Description

@mingfang

I'm trying to import this file https://data.opensanctions.org/datasets/20231205/peps/entities.ftm.json
but get the error

Traceback (most recent call last):                                                                                                                                                                                                                   
  File "/ingestors/ingestors/manager.py", line 220, in ingest                                                                                                                                                                                        
    self.delegate(ingestor_class, file_path, entity)                                                                                                                                                                                                 
  File "/ingestors/ingestors/manager.py", line 245, in delegate                                                                                                                                                                                      
    ingestor_class(self).ingest(file_path, entity)                                                                                                                                                                                                   
  File "/ingestors/ingestors/misc/jsonfile.py", line 32, in ingest                                                                                                                                                                                   
    raise ProcessingException("JSON file is too large.")                                                                                                                                                                                             
ingestors.exc.ProcessingException: JSON file is too large.      

https://github.com/alephdata/ingest-file/blob/3860024df29dc04d5f37dd47aee85f936f93c040/ingestors/misc/jsonfile.py#L16

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature-requestRequests for new features or enhancements of existing featurestriageThese issues need to be reviewed by the Aleph team

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0