Skip to content

GitLab

  • Projects
  • Groups
  • Snippets
  • Help
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in / Register
U
utilitybillscraper
  • Project overview
    • Project overview
    • Details
    • Activity
    • Releases
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 2
    • Issues 2
    • List
    • Boards
    • Labels
    • Service Desk
    • Milestones
    • Iterations
  • Merge Requests 0
    • Merge Requests 0
  • Requirements
    • Requirements
    • List
  • CI / CD
    • CI / CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Operations
    • Operations
    • Incidents
    • Environments
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • CI / CD
    • Code Review
    • Insights
    • Issue
    • Repository
    • Value Stream
  • Wiki
    • Wiki
  • Snippets
    • Snippets
  • Members
    • Members
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar

and though bugs are the bane of my existence, rest assured the wretched thing will get the best of care here

  • Confidential and Proprietary
  • BlocPower
  • utilitybillscraper
  • Wiki
  • Scraper Data Format

Last edited by Phil Condreay Jul 01, 2016
Page history

Scraper Data Format

In order to most easily integrate data between the utilityservice and the scrapers, data output from the actual scraper functions will be in a format very similar to that used by the blocpower endpoints. Each component will be identical to that in the utilityservice readme. There are a few exceptions for the sake of cross-referencing locally. Those, along with the overal structure, are shown below.

data = {
  'account': {
    ...
  },
  'meters': [
    {
      'cid': '[uuid] A local unique identifier for the meter.',
      ...
    },
    ...
  ],
  'meterids': [
    {
      'meter_cid': '[uuid] A local unique identifier for the meter associated with this id.',
      ...
    },
    ...
  ],
  'lineitems': [
    {
      'meter_cid': '[uuid] A local unique identifier for the meter associated with the lineitem.',
      ...
    },
    ...
  ]
}
Clone repository
  • Celery Broker (RabbitMQ) Development
  • Celery Broker (RabbitMQ) Production
  • Celery Broker (RabbitMQ) Testing
  • Celery Result Backend (Development)
  • Celery Result Backend (Production)
  • Celery Result Backend (Testing)
  • Celery Worker (Development)
  • Celery Worker (Production)
  • Celery Worker (Testing)
  • Home
  • Scraper Data Format