8000 Creating a new release from staging by d0nut-grapl · Pull Request #327 · grapl-security/grapl · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
This repository was archived by the owner on Dec 26, 2022. It is now read-only.

Creating a new release from staging #327

Merged
merged 874 commits into from
Oct 1, 2020
Merged

Creating a new release from staging #327

merged 874 commits into from
Oct 1, 2020

Conversation

d0nut-grapl
Copy link
Contributor

Which issue does this PR correspond to?

None / Cutting a release

What changes does this PR make to Grapl? Why?

  • Metrics
  • Dgraph TTL cleanup job
  • Updates to the build system
  • Better plugin deployment story
  • Analyzer lib rewrite
  • Rust source refactor for a couple of projects
  • Migration to dgraph-tonic
  • Various bug fixes in deployment, generators, merging, and operational hiccups

How were these changes tested?

  • Integration testing / Unit testing
  • e2e testing
  • local deployment + test data

jgrillo-grapl and others added 30 commits June 22, 2020 17:38
@jgrillo-grapl
CDK for grapl-dgraph-ttl (#121)
4a93a83 
* add --delay and --batch-size options to upload-sysmon-logs.py

* attempt to CDK

* add schedule rule

* updates for review comments

* address LGTM lint

* cdk README

* add extract-grapl-deployment-artifacts.sh

* WIP build is broken

* fix aws-cdk versions

* some updates from local testing

* WIP build still borked

* README update

* make dgraph-ttl a Construct instead of a NestedStack

* fix an issue with the handler reference

* some more updates from testing in sandbox

* more fixes
@jgrillo-grapl
normalize dgraph dns name handling (#126)
e6bd9f8
@inickles-grapl
Upgrade aws cdk to 1.46 to take advantage of fix for aws/aws-cdk#3463
c48d01a
@inickles-grapl
- Adding deploy name to support deploying multiple instances of Grapl…
db1cd02 
… to a

single AWS account.
- All Constructs now use an interface for constructor params beyond
scope and id. This essentially provides named params, making it clearer
what the arguments are for.
@inickles-grapl
Remove .env from .gitignore, env vars no longer used.
4613650
@inickles-grapl
Fix Grapl prefix from stackName issue.
274b8f2
@inickles-grapl
Fix EngagementUX Stack name.
3fc824e
@inickles-grapl
unused imports cleanup.
f352384
@inickles-grapl
Fix test code from template to new Grapl Stack params.
8618f97
@inickles-grapl
Fixing some hard-coded names to take a prefix.
7e7985e
@inickles-grapl
Fix name for retry handler.
e3f534e 8000
@inickles-grapl
Fixing hard-coded table names, which now take from env vars.
b599139 
Also gonna mix up our naming convention. For fun.
@inickles-grapl
jkz colin
7cd0d7a
@inickles-grapl
Add asset_id_mappings table and remove node_id_retry_table.
2da2d5a
@inickles-grapl
Add new env vars to docker-compose.yml
b247b64
@inickles-grapl
Remove swp file that should not be there.
b5cda04
@inickles-grapl
Moving dynamodb table name fetches for node-identifier to grapl-config.
033997b
@inickles-grapl
Adding MG_ALPHAS to docker-compose for dgraph-ttl.
2b8cffa
@inickles-grapl
Merge pull request #127 from grapl-security/cdk-naming
0d772fd 
CDK - Add support for multiple Grapl deployments to single AWS account
@jgrillo-grapl
Integrate cdk-watchful (#124)
92c6c99 
* whitespace

* add cdk-watchful dep

* vendor cdk-watchful 0.5.1

* get vendored cdk-watchful to build

* add watchful to the Grapl stack

* some fixes

* remove cdk-watchful DynamoDB stuff because we use on-demand pricing

* remove unused import

* instrument engagement and graphql

* updates from local testing

* make everything a NestedStack

* internal-74 fix destroy_all.sh

* remove dangerous S3 stuff
@inickles-grapl
Updating CDK README to match changes from previous PR.
f37735d
@inickles-grapl
Merge pull request #130 from grapl-security/readme
9b34308 
Updating CDK README to match changes from previous PR.
@andrea-grapl
Routing (#131)
f7accbf 
* added paging for graphQL endpoint

* added front-end pagination to plugins

* graphQL paging

* fixed duplicate pagination bug for lenses

* added styling for paging

* formatting

* Revert extra lenses

* Styling

* fixed any types

* revisions

* refactored custom routing to use react-router-dom HashRouter

* remove redirectTo function

* added logic to check if logged in

* removed unneeded props

* Improve performance of plugin page and fix warnings
@colin-grapl
Update sqs-lambda
95b510c
@colin-grapl
Update sqs-lambda
832bc1f
@colin-grapl
Bump versions for tokio, tokio-compat, other dependencies
fc3ce69
@inickles-grapl
Making the use of Watchful conditional on spec of email for watchful
10000
81c8240 
alerts.
@inickles-grapl
Let's not forget to pass this new param to the Grapl Stack.
23879da
@colin-grapl
Update graph-generator-lib
72b6b75
@colin-grapl
Glob deps
f389b27
d0nut-grapl and others added 22 commits September 25, 2020 16:51
@d0nut-grapl
Added comments and organized code a bit
e21968d
@d0nut-grapl
Merge branch 'staging' into issue-255-documentation
bf03976
@wimax-grapl
Integration tests no longer required (#301)
d8511e9
@colin-grapl @wimax-grapl
Store more information in schema_table (#300)
23fc41f 
* Resolve #299 by storing more information in schema_table

* Reformat

* Update provisioning and resolve an edge conflict?

Co-authored-by: wimax-grapl <69007229+wimax-grapl@users.noreply.github.com>
@d0nut-grapl
Merge branch 'staging' into issue-255-documentation
ef461ec
@d0nut-grapl
fixed tests
ce38fc1
@d0nut-grapl
changed per code review
03fe124
@d0nut-grapl
Merge pull request #265 from grapl-security/issue-255-documentation
aa83253 
Code cleanup and documentation work. Unfinished.
@wimax-grapl
Metric Forwarder: aggregate similar metrics to lower the total number…
4908b92 
… of calls to CloudWatch (and save money) (#305)

* Add accumulation/aggregation to the Metric Forwarder, grouping like MetricDatums together to lower the number of API calls we have to make.
@d0nut-grapl
Merged staging
e43c4ea
@inickles-grapl
Remove grapl-graph-descriptions dep rename in libs used by generators (…
2c3b59b 
…#304)

* Removing the dependency rename in Cargo.tomls from grapl-graph-descriptions to
graph-descriptions for libraries used by plugins: derive-dynamic-node
and graph-generator-lib. This should remove the requirement that plugins
would need to make the same rename in their Cargo.toml.

* Removing all other references to renamed grapl-graph-descriptions.
@dependabot
Bump boto3 from 1.14.44 to 1.15.8 in /src/python (#314)
90c5251 
Bumps [boto3](https://github.com/boto/boto3) from 1.14.44 to 1.15.8.
- [Release notes](https://github.com/boto/boto3/releases)
- [Changelog](https://github.com/boto/boto3/blob/develop/CHANGELOG.rst)
- [Commits](boto/boto3@1.14.44...1.15.8)

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@wimax-grapl
Push 'staging' to docker every time it gets a new push (#312)
0288177 
* Add a 'release Staging to Dockerhub every time code is pushed to Staging' workflow

* Refactor to reduce copied code between the two release scripts
@wimax-grapl
Bugfix for "push staging images to dockerhub" workflow (#316)
98df7d2 
* A bugfix the staging-to-docker thing
@d0nut-grapl
merged staging and fixed sysmon generator bugs
cc3689f
@d0nut-grapl
Merge branch 'staging' into issue-246-dgraph-tonic
d419e88
@d0nut-grapl
Forgot cargo fmt
7efae38
@wimax-grapl
chmod +rx the new build scripts (#317)
721caf2
@d0nut-grapl
Merge branch 'staging' into issue-246-dgraph-tonic
34d4e4f
@d0nut-grapl
Merge pull request #251 from grapl-security/issue-246-dgraph-tonic
3ef780e 
Resolves #246 - replaces dgraph-rs with dgraph-tonic in graph-merger
@d0nut-grapl
Merge branch 'master' into staging
9f17e91
@wimax-grapl
Merge pull request #322 from grapl-security/staging_master_merge
0681f0d 
Merging master into staging
@d0nut-grapl d0nut-grapl self-assigned this Oct 1, 2020
jgrillo-grapl
jgrillo-grapl approved these changes Oct 1, 2020
View reviewed changes
Copy link
Contributor
@jgrillo-grapl jgrillo-grapl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥇

@lgtm-com
Copy link
lgtm-com bot commented Oct 1, 2020

This pull request introduces 72 alerts and fixes 31 when merging 0681f0d into 8939772 - view on LGTM.com

new alerts:

  • 51 for Unused import
  • 6 for Module-level cyclic import
  • 4 for Unused local variable
  • 4 for 'import *' may pollute namespace
  • 3 for Unreachable code
  • 2 for Unused variable, import, function or class
  • 1 for Unnecessary pass
  • 1 for Variable defined multiple times

fixed alerts:

  • 22 for Unused import
  • 3 for Unused local variable
  • 2 for Missing variable declaration
  • 1 for Use of the return value of a procedure
  • 1 for Module is imported more than once
  • 1 for Variable defined multiple times
  • 1 for Wrong number of arguments in a call

@d0nut-grapl d0nut-grapl merged commit ff3740f into master Oct 1, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@jgrillo-grapl jgrillo-grapl jgrillo-grapl approved these changes

@colin-grapl colin-grapl Awaiting requested review from colin-grapl

@inickles-grapl inickles-grapl Awaiting requested review from inickles-grapl

@wimax-grapl wimax-grapl Awaiting requested review from wimax-grapl

Assignees

@d0nut-grapl d0nut-grapl

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@d0nut-grapl @jgrillo-grapl @inickles-grapl @andrea-grapl @colin-grapl @wimax-grapl
0