System.LimitException: Regex too complicated from LogEntryEventBuilder.applyDataMaskRules:

[EnglundAndreas]

Package Edition of Nebula Logger

Unlocked Package

Package Version of Nebula Logger

v4.12

New Bug Summary

I get an expected error when running a batch + queuable job due to locking error from a Query. So I have Nebula Logger that I want to log this error, but when it's trying to log my original error, I get an exception "System.LimitException: Regex too complicated".

Stack Trace from Nebula Logger (error is LogEntryEventBuilder.applyDataMaskRules):
Class.LogEntryEventBuilder.applyDataMaskRules: line 928, column 1
Class.LogEntryEventBuilder.setMessage: line 151, column 1
Class.Logger.error: line 838, column 1

[jongpie]

Hi @EnglundAndreas - do you know how long the string is that you're logging? And which parameters are you providing to Logger.error()? There are several overloads for that method (such as Logger.error(String), Logger.error(String, Exception), etc).

[EnglundAndreas]

It should be about 35 000 characters, I'm serializing the scope from the batchjob as a JSON so it's a bit string. I have an abstract custom Retry class that I'm using to log errors and be able to retry them from the error record.

Here is the method that logs the error, where "this" is the class that

private void logError(Exception e) {
	RetryException retryException = new RetryException();
	String json = JSON.serializePretty(this, true);
	String errorMessage = 'Error occured from Retryable class: ' + this.getClassName() + '. Please view related error log entry to Retry.';
	if (parentLogTransactionId != null) {
		errorMessage = 'Error when running retry flow. See parent log for original transaction.';
		Logger.setParentLogTransactionId(parentLogTransactionId);
	}
	Logger.error(errorMessage, e);
	Logger.error(this.getClassName() + SEPARATOR + json, retryException);
	Logger.saveLog();
}

This is the class that is being serialized (the properties is variables that I use to rerun the method on errors):
`global class CreateInvoicesQueueable extends Retryable implements Queueable, Finalizer, Database.AllowsCallouts {
List scope;
Invoice_Batch_Job__c currentJob;
private String originalTransactionId;

	CreateInvoicesQueueable(List<Asset> scope, Invoice_Batch_Job__c currentJob, String originalTransactionId) {
		this.scope = scope;
		this.currentJob = currentJob;
		this.originalTransactionId = originalTransactionId;
	}
	global void execute(QueueableContext context) {
		Logger.setParentLogTransactionId(this.originalTransactionId);
		executeRetryable();
	}`

Since the scope of the batch with a size of 200, although only contains Ids, it still becomes a long string. So understandable that the logger does not support these big error messages.

[jongpie]

@EnglundAndreas thank you! This is really helpful info to have. I'm not sure how much I'll be able to optimize the regex for data masking, but I'll plan to do some analysis & testing to see what's possible.

[Kartchie]

Hi @jongpie Thanks a lot for the great open-source tool 🙏
Just kindly checking if there’s any update or rough plan for this issue. Thanks!

[jongpie]

Hi @Kartchie - at the moment, I don't have any plans/timeline for working on this issue. When I last reviewed it, I didn't see an obvious way to optimize the existing regexes, so I don't currently have a clear path forward. If you/anyone would like to submit a PR to address this, I'd be happy to review.

[anthonygiuliano]

Hey @jongpie , just wanted to make sure you saw this pr. I don't think I'm allowed to mark it ready for review, but would love any feedback when you have some time

[tomcarman]

Hey - just flagging that I have also been encountering this issue. @anthonygiuliano thanks for the work on that PR. Hopefully it can get reviewed and merged at some point.