Skip to content
This repository has been archived by the owner on Jan 25, 2022. It is now read-only.

Fetch singer-io tap codebase #4

Open
wants to merge 42 commits into
base: master
Choose a base branch
from

Commits on Jun 28, 2021

  1. Fix ad_insights_country's primary key (#154)

    * Update PK for `ads_insights_country`
    
    * Update test expectations
    luandy64 authored Jun 28, 2021
    Configuration menu
    Copy the full SHA
    11ae7a9 View commit details
    Browse the repository at this point in the history
  2. Bump to v1.15.0, update changelog (#155)

    * Bump to v1.15.0, update changelog
    
    * Fix changelog headers
    luandy64 authored Jun 28, 2021
    Configuration menu
    Copy the full SHA
    6d6da5f View commit details
    Browse the repository at this point in the history

Commits on Jul 22, 2021

  1. Update streams list in README; fix typo (#156)

    * Update streams list in README; fix typo
    
    * Remove hourly audience breakdown
    
    Co-authored-by: Andy Lu <[email protected]>
    Erin Cochran and luandy64 authored Jul 22, 2021
    Configuration menu
    Copy the full SHA
    2c32048 View commit details
    Browse the repository at this point in the history

Commits on Aug 24, 2021

  1. Configuration menu
    Copy the full SHA
    c2130b5 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2021

  1. Configuration menu
    Copy the full SHA
    b8853e5 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0aab1ab View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2021

  1. Bump SDK to v12 (#164)

    * Bump facebook_business to 11.0.0
    
    * Get on the latest sdk version
    luandy64 authored Sep 20, 2021
    Configuration menu
    Copy the full SHA
    c33af77 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    1a510c1 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2021

  1. Parallelize CircleCI (#163)

    * Reorganize config file
    
    * Fix missing key
    
    * Make ensure_env run first
    
    * Run unit tests and pylint in parallel
    
    * Add checkouts to every job
    
    * Name steps, add parallelism to Unit Tests
    
    * Only run if you have tests
    
    * Parallelize integration tests; serialize unit tests
    
    * Acutally run integration tests
    
    * Fix copy pasta
    
    * Add logging around what tests are running
    
    * Fix typo
    
    * Remove unused code
    
    * Add slack notifications for failures
    
    * Reorder work to shrink the diff
    
    * Add build_daily back in
    
    * Add the version line back in
    
    * Update docker image
    
    * Fix run command for the newer docker image
    
    * Decouple tests without parallelism
    
    * Fix build_daily too
    
    * Fix path to tests
    
    * fail if we are missing a tap-tester test in the circle-config
    
    * reuse commit workflow as build-daily
    
    * fix typo
    
    * Add build job for github status
    
    * Add missing context
    
    * Refer to names of other jobs instead of the template?
    
    * Remove yaml reuse
    
    * Add deploy step to commit workflow, list jobs for build_daily workflow
    
    * Add filter to only deploy from master
    
    * Fix copy pasta
    
    * Add notifications on success and on failure
    
    Co-authored-by: kspeer <[email protected]>
    luandy64 and kspeer825 authored Sep 24, 2021
    Configuration menu
    Copy the full SHA
    e981088 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    09e173b View commit details
    Browse the repository at this point in the history

Commits on Nov 2, 2021

  1. Feature/retry insights job polling (#174)

    * Add sleep and retry for insights job polling
    
    * correct dylans typo
    
    * added tests, got tests passing
    
    * Makes api_get_with_retry function that uses retry wrapper
    
    * Style changes
    
    * Style changes 2
    
    * Version Bump
    
    * removed count
    dsprayberry authored Nov 2, 2021
    Configuration menu
    Copy the full SHA
    10bad1c View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2021

  1. Crest Work (#176)

    * TDL-9728: Stream `ads_insights_age_gender` has unexpected datatype for replication key field `date_start` (#172)
    
    * added format as date-time in schema file
    
    * added code coverage
    
    * added check for date format in the bookmark test
    
    * added the check for first sync messages
    
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-9809: `forced-replication-method` missing from metadata for some streams and TDL-9872: replication keys are not specified as expected in discoverable metadata	 (#167)
    
    * added valid replication keys in catalog
    
    * modified the code
    
    * TDL-9809: Added replication keys in metadata
    
    * adde code coverage
    
    * Resolved review comments
    
    Co-authored-by: harshpatel4_crest <[email protected]>
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-7455: Add tap-tester test to verify replication of deleted records	 (#168)
    
    * TDL-7455: Added archived data integration test
    
    * TDL-7455: Updated integration test
    
    * added code coverage
    
    * Resolved review comment
    
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-7596: Add tap-tester test for attribution window (#169)
    
    * added tap tester test for attribution window
    
    * updated the code
    
    * added code coverage
    
    * updated the code according to the comments
    
    * updated code to raise error when attribution window is not 1, 7, 28
    
    * test: run invalid attribution window intergation test
    
    * updated test case
    
    * test: updated test case code
    
    * test: test invalid attribution window
    
    * test: test invalid attribution window
    
    * test: test invalid attribution window
    
    * test: test invalid attribution window
    
    * test: run invalid attribution window test case
    
    * added intergation test for invalid sttribution window
    
    Co-authored-by: namrata270998 <[email protected]>
    
    Co-authored-by: namrata270998 <[email protected]>
    Co-authored-by: savan-chovatiya <[email protected]>
    3 people authored Nov 19, 2021
    Configuration menu
    Copy the full SHA
    1af73ac View commit details
    Browse the repository at this point in the history

Commits on Nov 22, 2021

  1. Bump Version 1.18.0 (#177)

    Co-authored-by: KrishnanG <[email protected]>
    KrisPersonal and KrishnanG authored Nov 22, 2021
    Configuration menu
    Copy the full SHA
    1e55199 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    65aea9e View commit details
    Browse the repository at this point in the history

Commits on Nov 23, 2021

  1. TDL-6148: Catch and retry Attribute error and TDL-13267: Fix AdCreati…

    …ve requests that are not retrying (#171)
    
    * TDL-6148: Added retry for Attribute error of sync batches
    
    * TDL-6148: Removed unused imports from unit tests
    
    * TDL-13267: Added retry for 500 error of AdCreatives
    
    * TDL-6148: Add AttributeError backoff for all sync functions
    
    * added code coverage
    
    * Resolved review comment
    
    * Resolved review comments
    
    * Added code comments
    
    * Resolved review comment
    
    * TDL-9728: Stream `ads_insights_age_gender` has unexpected datatype for replication key field `date_start` (#172)
    
    * added format as date-time in schema file
    
    * added code coverage
    
    * added check for date format in the bookmark test
    
    * added the check for first sync messages
    
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-9809: `forced-replication-method` missing from metadata for some streams and TDL-9872: replication keys are not specified as expected in discoverable metadata	 (#167)
    
    * added valid replication keys in catalog
    
    * modified the code
    
    * TDL-9809: Added replication keys in metadata
    
    * adde code coverage
    
    * Resolved review comments
    
    Co-authored-by: harshpatel4_crest <[email protected]>
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-7455: Add tap-tester test to verify replication of deleted records	 (#168)
    
    * TDL-7455: Added archived data integration test
    
    * TDL-7455: Updated integration test
    
    * added code coverage
    
    * Resolved review comment
    
    Co-authored-by: namrata270998 <[email protected]>
    
    Co-authored-by: namrata270998 <[email protected]>
    Co-authored-by: Harsh <[email protected]>
    Co-authored-by: harshpatel4_crest <[email protected]>
    Co-authored-by: KrisPersonal <[email protected]>
    5 people authored Nov 23, 2021
    Configuration menu
    Copy the full SHA
    427232f View commit details
    Browse the repository at this point in the history

Commits on Nov 29, 2021

  1. Bump to version 1.18.1 (#179)

    * Bump to version 1.18.1
    
    * Wrong Syntax
    
    Co-authored-by: KrishnanG <[email protected]>
    KrisPersonal and KrishnanG authored Nov 29, 2021
    Configuration menu
    Copy the full SHA
    59e831c View commit details
    Browse the repository at this point in the history

Commits on Dec 14, 2021

  1. TDL-15863: Implement Request Timeout (#173)

    * TDL-15863: Added request timeout and unit tests
    
    * TDL-15863: Added unit tests
    
    * TDL-15863: Removed commented code
    
    * TDL-15863: Added request_timeout lookup from config also
    
    * added code coverage
    
    * TDL-15863: Added float type cast for timeout
    
    * Updated comment
    
    * added code change for empty string timeout value from config
    
    * Added empty string handling in request_timeout param
    
    * Resolved review comment
    
    * Added if else for request timeout
    
    * Added backoff for ConnectionError
    
    * TDL-9728: Stream `ads_insights_age_gender` has unexpected datatype for replication key field `date_start` (#172)
    
    * added format as date-time in schema file
    
    * added code coverage
    
    * added check for date format in the bookmark test
    
    * added the check for first sync messages
    
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-9809: `forced-replication-method` missing from metadata for some streams and TDL-9872: replication keys are not specified as expected in discoverable metadata	 (#167)
    
    * added valid replication keys in catalog
    
    * modified the code
    
    * TDL-9809: Added replication keys in metadata
    
    * adde code coverage
    
    * Resolved review comments
    
    Co-authored-by: harshpatel4_crest <[email protected]>
    Co-authored-by: namrata270998 <[email protected]>
    
    * TDL-7455: Add tap-tester test to verify replication of deleted records	 (#168)
    
    * TDL-7455: Added archived data integration test
    
    * TDL-7455: Updated integration test
    
    * added code coverage
    
    * Resolved review comment
    
    Co-authored-by: namrata270998 <[email protected]>
    
    Co-authored-by: namrata270998 <[email protected]>
    Co-authored-by: harshpatel4_crest <[email protected]>
    Co-authored-by: Harsh <[email protected]>
    Co-authored-by: KrisPersonal <[email protected]>
    5 people authored Dec 14, 2021
    Configuration menu
    Copy the full SHA
    8286e9b View commit details
    Browse the repository at this point in the history

Commits on Dec 15, 2021

  1. Bump version for Request Timeout (#181)

    Co-authored-by: KrishnanG <[email protected]>
    KrisPersonal and KrishnanG authored Dec 15, 2021
    Configuration menu
    Copy the full SHA
    b678b9a View commit details
    Browse the repository at this point in the history

Commits on Dec 21, 2021

  1. move build time and notifications (#183)

    * move build time and notifications
    
    * parallel integration tests with 'glob', break out deploy to multiple jobs'
    
    * parallelism = 9
    
    * remove unnecessary check file
    
    * push_pypi waits only on git_tag
    kspeer825 authored Dec 21, 2021
    Configuration menu
    Copy the full SHA
    b69c23c View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2022

  1. remove setuptools and pip upgrade (#185)

    * remove setuptools and pip upgrade
    
    * pin deps
    
    Co-authored-by: kspeer <[email protected]>
    kspeer825 and kspeer authored Feb 14, 2022
    Configuration menu
    Copy the full SHA
    01088cd View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2022

  1. Added test cases or attribution window (#189)

    * Added test cases or attribution window
    
    * added a decorator to skip the test
    manand31 authored Apr 13, 2022
    Configuration menu
    Copy the full SHA
    86a2cc4 View commit details
    Browse the repository at this point in the history

Commits on Apr 22, 2022

  1. Qa/logging tap tester (#190)

    *using tap-tester logger
    
    * remove singer import
    
    * appease Dylan (PR feedback)
    
    * fix attr window test - broken with previous change
    
    * update field selection test
    
    * fix invalid attr window and start date tests
    
    Co-authored-by: kspeer <[email protected]>
    kspeer825 and kspeer authored Apr 22, 2022
    Configuration menu
    Copy the full SHA
    3318ad9 View commit details
    Browse the repository at this point in the history

Commits on Jun 15, 2022

  1. Bump to api version v13 (#191)

    * bump to v13
    
    * Change CHANGElog and setup.py
    
    Co-authored-by: KrisPersonal <[email protected]>
    Co-authored-by: KrishnanG <[email protected]>
    3 people authored Jun 15, 2022
    Configuration menu
    Copy the full SHA
    ccf14ab View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2022

  1. save test logs, use tt logger (#196)

    * save test logs, use tt logger
    
    * fix logger usage
    
    Co-authored-by: kspeer <[email protected]>
    kspeer825 and kspeer authored Aug 18, 2022
    Configuration menu
    Copy the full SHA
    d5a6b31 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2022

  1. Qa/fix date range in tests (#199)

    * use test data from 2021
    
    * update bookmarks test for insights latest data
    
    * fix start date test, and timdelta_formatted implementation
    
    * account for conversion window in start date choice
    
    * fix timedelta formatted usage in attr window test
    
    Co-authored-by: kspeer <[email protected]>
    kspeer825 and kspeer authored Sep 8, 2022
    Configuration menu
    Copy the full SHA
    df379de View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2022

  1. Bump facebook API to v14.0 (#201)

    * Bump facebook API to v14.0 which is used in sdk facebook_business version 14.0.0
    
    * New tap-facebook bump version 1.18.4
    shantanu73 authored Oct 20, 2022
    Configuration menu
    Copy the full SHA
    ecf46e5 View commit details
    Browse the repository at this point in the history

Commits on Mar 8, 2023

  1. Configuration menu
    Copy the full SHA
    29ea77e View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. Upgrade facebook_business SDK to v16.0.2 (#213)

    * upgrade SDK to v16.0.2
    
    * version bump and CHANGELOG
    kethan1122 authored Apr 11, 2023
    Configuration menu
    Copy the full SHA
    5c62610 View commit details
    Browse the repository at this point in the history

Commits on Apr 24, 2023

  1. Configuration menu
    Copy the full SHA
    2456f70 View commit details
    Browse the repository at this point in the history

Commits on Jun 26, 2023

  1. SDK bump, Version Bump, Changelog (#220)

    Co-authored-by: Ubuntu <[email protected]>
    dsprayberry and Ubuntu authored Jun 26, 2023
    Configuration menu
    Copy the full SHA
    5381c8d View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2023

  1. Add conversions to insights streams (#204)

    * conversions
    
    * feature - add conversion to all streams
    GtheSheep authored Aug 16, 2023
    Configuration menu
    Copy the full SHA
    8cef617 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    9761160 View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2023

  1. TDl-19503 (#225)

    * TDl-19503
    
    * new base file
    JYOTHINARAYANSETTY authored Aug 31, 2023
    Configuration menu
    Copy the full SHA
    a30c5b3 View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2023

  1. Add retry logic for status code - 503 (#226)

    * add retry logic for status code - 503
    
    * handle the attribute error by checking the error body instance is dictionary
    
    * Update error body in test case and indent the code
    
    * setup and changelog update
    sgandhi1311 authored Sep 13, 2023
    Configuration menu
    Copy the full SHA
    510eeb0 View commit details
    Browse the repository at this point in the history

Commits on Oct 13, 2023

  1. Configuration menu
    Copy the full SHA
    37274c3 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2023

  1. Tdl 9685 (#227)

    * All fields Test using new framework
    
    * Add method to exclude the non-upsert fields
    
    * Implemented PR Review comments
    
    * excluded the problematic streams
    bhuvana-talend authored Oct 18, 2023
    Configuration menu
    Copy the full SHA
    7a94090 View commit details
    Browse the repository at this point in the history

Commits on Oct 26, 2023

  1. all_fields_test, update streams to test, move upsert method to missin…

    …g fields, document in jira (#233)
    bhtowles authored Oct 26, 2023
    Configuration menu
    Copy the full SHA
    d9f361e View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2023

  1. Facebook test client WIP, campaigns stream only (#231)

    * Facebook test client WIP, campaigns stream only
    
    * Add pagination test for campaigns stream, update new base file and client
    
    * First review comments, add adsets stream, start work on ads
    
    * Support for adcreative, ads, adsets, and campaigns, get only for ads_insights
    
    * Clean up for next review round
    
    * PR review, clean up for further review
    
    * PR review comments round 2, pass limit and date range to test client get request
    
    * Convert times to utc to compare all datetime objects as tz naive
    
    * Use base_suite parse_date
    
    * Final review comments, add TODO to update get_account_objects(), update BaseCase page_size(), update self.start_date pattern
    bhtowles authored Nov 15, 2023
    Configuration menu
    Copy the full SHA
    add18f1 View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. Upgrade python version to 3.11.7 (#237)

    * test tap-facebook on python 3.11
    
    * version bump and changelog update
    
    * standard image base
    
    -----------------------------
    leslievandemark authored Jan 23, 2024
    Configuration menu
    Copy the full SHA
    1482632 View commit details
    Browse the repository at this point in the history

Commits on Mar 6, 2024

  1. Configuration menu
    Copy the full SHA
    6aeb27e View commit details
    Browse the repository at this point in the history

Commits on Apr 15, 2024

  1. Fix for summary param error - Added retry logic (#239)

    * upgrade the facebook sdk version
    
    * place the facebook_business sdk locally and add retry for the summary param error
    
    * Monkey patch the original function(call) of facebook business sdk
    
    * update logger statement
    sgandhi1311 authored Apr 15, 2024
    Configuration menu
    Copy the full SHA
    534bded View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Configuration menu
    Copy the full SHA
    2b69484 View commit details
    Browse the repository at this point in the history