Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

authz: Stdout logger #6230

Merged
merged 30 commits into from
May 17, 2023
Merged
Show file tree
Hide file tree
Changes from 20 commits
Commits
Show all changes
30 commits
Select commit Hold shift + click to select a range
065089d
Draft of StdoutLogger
erm-g Apr 25, 2023
e17b64e
Fitting StdoutLogger to lb patterns
erm-g Apr 25, 2023
92b53a7
Merge branch 'grpc:master' into AuditLoggerRegistry
erm-g Apr 27, 2023
5665daa
conversion from proto to json for laudit loggers
erm-g Apr 28, 2023
95ebc88
Tests for multiple loggers and empty Options
erm-g Apr 28, 2023
bcf4256
Added LoggerConfig impl
erm-g May 1, 2023
b918c0a
Switched to grpcLogger and added a unit test comparing log with os.St…
erm-g May 4, 2023
861d9f2
Minor fix in exception handling wording
erm-g May 4, 2023
270948b
Added timestamp for logging statement
erm-g May 4, 2023
8859707
Changed format to json and added custom marshalling
erm-g May 7, 2023
c073753
Migration to log.go and additional test for a full event
erm-g May 7, 2023
c6dd904
Migration of stdout logger to a separate package
erm-g May 7, 2023
e72bfa2
migration to grpcLogger, unit test fix
erm-g May 8, 2023
9866f61
Delete xds parsing functionality. Will be done in a separate PR
erm-g May 8, 2023
0d9a56e
Delete xds parsing functionality. Will be done in a separate PR
erm-g May 8, 2023
8c24380
Address PR comments (embedding interface, table test, pointer optimiz…
erm-g May 9, 2023
317f501
vet.sh fixes
erm-g May 9, 2023
e0800ba
Address PR comments
erm-g May 10, 2023
e0c53d8
Commit for go tidy changes
erm-g May 10, 2023
da716bb
vet.sh fix for buf usage
erm-g May 10, 2023
7c36609
Address PR comments
erm-g May 11, 2023
c903401
Address PR comments
erm-g May 11, 2023
9bcb689
Address PR comments (easwars)
erm-g May 12, 2023
a1e3e7a
Address PR comments (luwei)
erm-g May 14, 2023
c74d21b
Migrate printing to standard out from log package level func to a Log…
erm-g May 15, 2023
e6c450b
Changed event Timestamp format back to RFC3339
erm-g May 15, 2023
f60c376
Address PR comments
erm-g May 16, 2023
8f0ad3c
Address PR comments
erm-g May 16, 2023
6ef31dd
Address PR comments
erm-g May 16, 2023
d663a6d
Address PR comments
erm-g May 17, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
99 changes: 99 additions & 0 deletions authz/audit/stdout/stdout_logger.go
Original file line number Diff line number Diff line change
@@ -0,0 +1,99 @@
/*
*
* Copyright 2023 gRPC authors.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*
*/

// Package stdout defines an stdout audit logger.
package stdout
erm-g marked this conversation as resolved.
Show resolved Hide resolved

import (
"encoding/json"
"log"
"time"

"google.golang.org/grpc/authz/audit"
"google.golang.org/grpc/grpclog"
)

var grpcLogger = grpclog.Component("authz-audit")
erm-g marked this conversation as resolved.
Show resolved Hide resolved

func init() {
audit.RegisterLoggerBuilder(&loggerBuilder{})
}

type event struct {
FullMethodName string `json:"fullMethodName"`
rockspore marked this conversation as resolved.
Show resolved Hide resolved
Principal string `json:"principal"`
PolicyName string `json:"policyName"`
MatchedRule string `json:"matchedRule"`
Authorized bool `json:"authorized"`
// Timestamp represents time when Log method prints the audit.Event
Timestamp string `json:"timestamp"`
easwars marked this conversation as resolved.
Show resolved Hide resolved
}

// StdoutLogger contains Log method to be invoked to log audit.Event.
easwars marked this conversation as resolved.
Show resolved Hide resolved
type logger struct {
}

// Log marshals the audit.Event to json and prints it using log.go
easwars marked this conversation as resolved.
Show resolved Hide resolved
func (logger *logger) Log(event *audit.Event) {
rockspore marked this conversation as resolved.
Show resolved Hide resolved
jsonBytes, err := json.Marshal(convertEvent(event))
erm-g marked this conversation as resolved.
Show resolved Hide resolved
rockspore marked this conversation as resolved.
Show resolved Hide resolved
if err != nil {
grpcLogger.Errorf("failed to marshal AuditEvent data to JSON: %v", err)
easwars marked this conversation as resolved.
Show resolved Hide resolved
}
log.Println(string(jsonBytes))
}

const (
stdName = "stdout"
rockspore marked this conversation as resolved.
Show resolved Hide resolved
)
easwars marked this conversation as resolved.
Show resolved Hide resolved

// LoggerConfig embeds audit.LoggerConfig
easwars marked this conversation as resolved.
Show resolved Hide resolved
type LoggerConfig struct {
easwars marked this conversation as resolved.
Show resolved Hide resolved
audit.LoggerConfig
}

// StdoutLoggerBuilder contains information to build StdoutLogger
easwars marked this conversation as resolved.
Show resolved Hide resolved
type loggerBuilder struct{}

// Name returns a hardcoded name of the StdoutLogger
easwars marked this conversation as resolved.
Show resolved Hide resolved
func (loggerBuilder) Name() string {
rockspore marked this conversation as resolved.
Show resolved Hide resolved
return stdName
}

// Build returns default StdoutLogger (audit.LoggerConfig is ignored)
easwars marked this conversation as resolved.
Show resolved Hide resolved
func (*loggerBuilder) Build(audit.LoggerConfig) audit.Logger {
return &logger{}
}

// ParseLoggerConfig returns LoggerConfig (json.RawMessage is ignored)
easwars marked this conversation as resolved.
Show resolved Hide resolved
func (*loggerBuilder) ParseLoggerConfig(config json.RawMessage) (audit.LoggerConfig, error) {
if config != nil {
rockspore marked this conversation as resolved.
Show resolved Hide resolved
grpcLogger.Warningf("Config value %v ignored, StdoutLogger doesn't support custom configs", string(config))
easwars marked this conversation as resolved.
Show resolved Hide resolved
}
return &LoggerConfig{}, nil
}

func convertEvent(auditEvent *audit.Event) *event {
return &event{
FullMethodName: auditEvent.FullMethodName,
Principal: auditEvent.Principal,
PolicyName: auditEvent.PolicyName,
MatchedRule: auditEvent.MatchedRule,
Authorized: auditEvent.Authorized,
Timestamp: time.Now().Format(time.RFC3339),
rockspore marked this conversation as resolved.
Show resolved Hide resolved
}
}
117 changes: 117 additions & 0 deletions authz/audit/stdout/stdout_logger_test.go
Original file line number Diff line number Diff line change
@@ -0,0 +1,117 @@
/*
*
* Copyright 2023 gRPC authors.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
* See the License for the specific language governing permissions and
* limitations under the License.
*
*/

package stdout

import (
"bytes"
"encoding/json"
"log"
"strings"
"testing"

"github.com/google/go-cmp/cmp"
"google.golang.org/grpc/authz/audit"
"google.golang.org/grpc/internal/grpctest"
)

var (
content = json.RawMessage(`{"name": "conf", "val": "to be ignored"}`)
builder = &loggerBuilder{}
config, _ = builder.ParseLoggerConfig(content)
auditLogger = builder.Build(config)
)
easwars marked this conversation as resolved.
Show resolved Hide resolved

erm-g marked this conversation as resolved.
Show resolved Hide resolved
type s struct {
grpctest.Tester
}

func Test(t *testing.T) {
erm-g marked this conversation as resolved.
Show resolved Hide resolved
grpctest.RunSubTests(t, s{})
}

func (s) TestStdoutLogger_Log(t *testing.T) {
tests := map[string]struct {
event *audit.Event
wantMessage string
wantErr string
}{
rockspore marked this conversation as resolved.
Show resolved Hide resolved
"few fields": {
event: &audit.Event{PolicyName: "test policy", Principal: "test principal"},
wantMessage: `{"fullMethodName":"","principal":"test principal","policyName":"test policy","matchedRule":"","authorized":false`,
},
"all fields": {
event: &audit.Event{
FullMethodName: "/helloworld.Greeter/SayHello",
Principal: "spiffe://example.org/ns/default/sa/default/backend",
PolicyName: "example-policy",
MatchedRule: "dev-access",
Authorized: true,
},
wantMessage: `{"fullMethodName":"/helloworld.Greeter/SayHello",` +
`"principal":"spiffe://example.org/ns/default/sa/default/backend","policyName":"example-policy",` +
`"matchedRule":"dev-access","authorized":true`,
},
}

var buf bytes.Buffer
log.SetOutput(&buf)
log.SetFlags(0)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can these be moved to be inside t.Run?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I moved the first two, but log.SetFlags(0) looks more global so I left it as is

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to have a good reason for them to be outside of t.Run(). I would say move everything to be inside of t.Run() so that your sub-tests are independent of each other.


for name, test := range tests {
t.Run(name, func(t *testing.T) {
auditLogger.Log(test.event)
var e event
err := json.Unmarshal(buf.Bytes(), &e)
if err != nil {
t.Fatalf("Unexpected error\n%v", err)
}
easwars marked this conversation as resolved.
Show resolved Hide resolved
if len(strings.TrimSpace(e.Timestamp)) == 0 {
easwars marked this conversation as resolved.
Show resolved Hide resolved
t.Fatalf("Resulted event has no timestamp\n%v", e)
easwars marked this conversation as resolved.
Show resolved Hide resolved
}

if diff := cmp.Diff(trimEvent(e), test.event); diff != "" {
t.Fatalf("Unexpected message\ndiff (-want +got):\n%s", diff)
easwars marked this conversation as resolved.
Show resolved Hide resolved
}
buf.Reset()
easwars marked this conversation as resolved.
Show resolved Hide resolved
})
}

easwars marked this conversation as resolved.
Show resolved Hide resolved
}

func (s) TestStdoutLoggerBuilder_NilConfig(t *testing.T) {
builder = &loggerBuilder{}
config, err := builder.ParseLoggerConfig(nil)
if err != nil {
t.Fatalf("Unexpected error\n%v", err)
easwars marked this conversation as resolved.
Show resolved Hide resolved
}
auditLogger = builder.Build(config)
if auditLogger == nil {
t.Fatalf("Unexpected error\nAuditLogger is nil")
}
easwars marked this conversation as resolved.
Show resolved Hide resolved
}

func trimEvent(testEvent event) *audit.Event {
easwars marked this conversation as resolved.
Show resolved Hide resolved
return &audit.Event{
FullMethodName: testEvent.FullMethodName,
Principal: testEvent.Principal,
PolicyName: testEvent.PolicyName,
MatchedRule: testEvent.MatchedRule,
Authorized: testEvent.Authorized,
}
}