Jul 16 17:30:45.819208 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 16 17:30:45.819361 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 16 17:30:45.819459 ip-10-0-137-76 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 16 17:30:45.820082 ip-10-0-137-76 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 16 17:30:56.934021 ip-10-0-137-76 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 16 17:30:56.934039 ip-10-0-137-76 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d4f02581367241eba3acad7cf42f4d7a --
Jul 16 17:32:55.239613 ip-10-0-137-76 systemd[1]: Starting Kubernetes Kubelet...
Jul 16 17:32:55.645953 ip-10-0-137-76 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:32:55.645953 ip-10-0-137-76 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 16 17:32:55.645953 ip-10-0-137-76 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:32:55.645953 ip-10-0-137-76 kubenswrapper[2577]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 16 17:32:55.645953 ip-10-0-137-76 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 16 17:32:55.647167 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.647033    2577 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 16 17:32:55.654335 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654313    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.654335 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654331    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.654335 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654337    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.654335 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654340    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654343    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654347    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654352    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654356    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654359    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654362    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654366    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654370    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654374    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654378    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654381    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654384    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654387    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654390    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654393    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654397    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654400    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654403    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.654525 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654406    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654409    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654412    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654416    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654419    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654421    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654424    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654427    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654430    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654433    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654435    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654438    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654441    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654445    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654448    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654451    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654455    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654458    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654461    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654464    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.655012 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654466    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654471    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654475    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654478    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654482    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654485    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654487    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654490    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654495    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654498    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654502    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654505    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654508    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654511    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654514    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654517    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654519    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654522    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654525    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654528    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.655546 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654531    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654534    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654537    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654540    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654543    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654546    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654549    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654553    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654556    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654559    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654562    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654564    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654567    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654570    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654572    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654575    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654578    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654581    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654583    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654586    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.656064 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654589    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654593    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654595    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654598    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654601    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654604    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654606    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654609    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654612    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654614    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654617    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654620    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654623    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654625    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654628    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654631    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.654651    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655426    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655435    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655439    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.656587 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655443    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655446    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655450    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655453    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655456    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655459    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655462    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655466    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655469    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655472    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655475    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655478    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655481    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655484    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655488    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655491    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655494    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655496    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655499    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655502    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.657133 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655505    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655507    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655510    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655513    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655515    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655518    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655521    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655523    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655526    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655529    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655532    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655535    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655538    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655541    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655544    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655546    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655549    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655552    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655555    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.657666 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655558    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655561    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655564    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655567    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655569    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655572    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655575    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655578    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655581    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655584    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655586    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655589    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655592    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655594    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655597    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655601    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655605    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655609    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655612    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.658154 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655615    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655619    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655621    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655627    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655630    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655633    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655636    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655640    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655644    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655647    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655650    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655653    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655656    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655659    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655663    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655666    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655669    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655671    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655674    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655677    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.658647 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655680    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655682    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655694    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655698    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655701    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655704    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655707    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655710    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655712    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655715    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655718    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655720    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655723    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655726    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655729    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655733    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655738    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.655741    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656175    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.659155 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656182    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656187    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656191    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656194    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656197    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656201    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656205    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656209    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656212    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656215    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656218    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656221    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656224    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656227    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656229    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656233    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656236    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656239    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656241    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.659677 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656244    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656247    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656250    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656252    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656255    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656258    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656261    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656264    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656267    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656271    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656274    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656277    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656280    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656283    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656285    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656288    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656291    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656294    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656296    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656299    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.660183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656302    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656305    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656307    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656310    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656313    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656316    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656319    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656321    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656324    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656327    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656330    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656333    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656335    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656338    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656341    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656344    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656346    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656349    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656351    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656354    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.660717 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656357    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656378    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656382    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656385    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656388    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656391    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656394    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656397    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656399    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656402    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656405    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656408    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656411    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656413    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656416    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656419    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656422    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656424    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656427    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.661248 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656430    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656433    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656435    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656439    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656441    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656444    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656447    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656449    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656452    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656455    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656458    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656461    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656463    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656466    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656471    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656474    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656477    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656480    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656483    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.656485    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.661756 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656552    2577 flags.go:64] FLAG: --address="0.0.0.0"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656559    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656565    2577 flags.go:64] FLAG: --anonymous-auth="true"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656569    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656573    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656576    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656580    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656585    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656588    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656591    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656595    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656599    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656602    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656606    2577 flags.go:64] FLAG: --cgroup-root=""
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656609    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656612    2577 flags.go:64] FLAG: --client-ca-file=""
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656616    2577 flags.go:64] FLAG: --cloud-provider="external"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656619    2577 flags.go:64] FLAG: --cluster-dns="[]"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656623    2577 flags.go:64] FLAG: --cluster-domain=""
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656626    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656629    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656632    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656636    2577 flags.go:64] FLAG: --container-log-max-files="5"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656640    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 16 17:32:55.662249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656643    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656646    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656651    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656654    2577 flags.go:64] FLAG: --contention-profiling="false"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656657    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656660    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656663    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656667    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656671    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656674    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656677    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656680    2577 flags.go:64] FLAG: --enable-load-reader="false"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656683    2577 flags.go:64] FLAG: --enable-server="true"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656686    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656690    2577 flags.go:64] FLAG: --event-burst="100"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656693    2577 flags.go:64] FLAG: --event-qps="50"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656696    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656699    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656703    2577 flags.go:64] FLAG: --eviction-hard=""
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656707    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656710    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656713    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656716    2577 flags.go:64] FLAG: --eviction-soft=""
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656719    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656722    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 16 17:32:55.662901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656725    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656729    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656732    2577 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656735    2577 flags.go:64] FLAG: --fail-swap-on="true"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656738    2577 flags.go:64] FLAG: --feature-gates=""
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656742    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656745    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656748    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656753    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656756    2577 flags.go:64] FLAG: --healthz-port="10248"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656760    2577 flags.go:64] FLAG: --help="false"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656763    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-137-76.ec2.internal"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656766    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656769    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656773    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656776    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656780    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656783    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656786    2577 flags.go:64] FLAG: --image-service-endpoint=""
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656790    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656793    2577 flags.go:64] FLAG: --kube-api-burst="100"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656796    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656799    2577 flags.go:64] FLAG: --kube-api-qps="50"
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656802    2577 flags.go:64] FLAG: --kube-reserved=""
Jul 16 17:32:55.663620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656805    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656808    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656812    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656815    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656818    2577 flags.go:64] FLAG: --lock-file=""
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656821    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656824    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656827    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656833    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656836    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656839    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656842    2577 flags.go:64] FLAG: --logging-format="text"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656845    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656849    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656852    2577 flags.go:64] FLAG: --manifest-url=""
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656855    2577 flags.go:64] FLAG: --manifest-url-header=""
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656860    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656864    2577 flags.go:64] FLAG: --max-open-files="1000000"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656868    2577 flags.go:64] FLAG: --max-pods="110"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656871    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656875    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656878    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656881    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656884    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656887    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 16 17:32:55.664663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656890    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656898    2577 flags.go:64] FLAG: --node-status-max-images="50"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656901    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656904    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656907    2577 flags.go:64] FLAG: --pod-cidr=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656910    2577 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656916    2577 flags.go:64] FLAG: --pod-manifest-path=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656919    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656923    2577 flags.go:64] FLAG: --pods-per-core="0"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656926    2577 flags.go:64] FLAG: --port="10250"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656929    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656932    2577 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-043a1fcf23d677caa"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656935    2577 flags.go:64] FLAG: --qos-reserved=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656938    2577 flags.go:64] FLAG: --read-only-port="10255"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656941    2577 flags.go:64] FLAG: --register-node="true"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656944    2577 flags.go:64] FLAG: --register-with-taints=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656948    2577 flags.go:64] FLAG: --registry-burst="10"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656951    2577 flags.go:64] FLAG: --registry-qps="5"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656954    2577 flags.go:64] FLAG: --reserved-cpus=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656957    2577 flags.go:64] FLAG: --reserved-memory=""
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656961    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656964    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656967    2577 flags.go:64] FLAG: --rotate-certificates="false"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656972    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656975    2577 flags.go:64] FLAG: --runonce="false"
Jul 16 17:32:55.665793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656978    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656981    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656984    2577 flags.go:64] FLAG: --seccomp-default="false"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656987    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656990    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656993    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.656997    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657000    2577 flags.go:64] FLAG: --storage-driver-password="root"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657003    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657006    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657009    2577 flags.go:64] FLAG: --storage-driver-user="root"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657012    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657015    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657018    2577 flags.go:64] FLAG: --system-cgroups=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657021    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657026    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657029    2577 flags.go:64] FLAG: --tls-cert-file=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657032    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657036    2577 flags.go:64] FLAG: --tls-min-version=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657039    2577 flags.go:64] FLAG: --tls-private-key-file=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657042    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657045    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657048    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657051    2577 flags.go:64] FLAG: --v="2"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657055    2577 flags.go:64] FLAG: --version="false"
Jul 16 17:32:55.666707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657060    2577 flags.go:64] FLAG: --vmodule=""
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657064    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.657067    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657182    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657187    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657194    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657197    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657200    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657203    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657206    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657209    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657212    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657215    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657219    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657222    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657226    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657229    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657232    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657235    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.667356 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657238    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657241    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657244    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657246    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657249    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657252    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657255    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657258    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657260    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657263    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657266    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657268    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657271    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657274    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657277    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657280    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657282    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657285    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657291    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657294    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.667939 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657296    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657299    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657302    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657305    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657308    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657311    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657314    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657317    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657319    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657322    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657325    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657328    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657331    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657333    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657336    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657340    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657344    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657347    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657350    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657353    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.668687 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657356    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657359    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657378    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657382    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657384    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657387    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657390    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657394    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657397    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657400    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657405    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657408    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657411    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657414    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657417    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657420    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657423    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657425    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657428    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.669631 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657431    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657434    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657436    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657439    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657442    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657445    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657447    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657450    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657453    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657456    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657460    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657463    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657466    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657469    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657472    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657476    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657479    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657482    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657485    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.670215 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657488    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657491    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657494    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657496    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.657502    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.658316    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.666266    2577 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.666286    2577 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.668210    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.668227    2577 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668324    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668332    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668338    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668344    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.670990 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668349    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668355    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668360    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668380    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668386    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668391    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668396    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668401    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668406    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668410    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668415    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668419    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668423    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668427    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668432    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668437    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668441    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668445    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668450    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668454    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.671646 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668461    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668465    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668470    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668475    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668479    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668485    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668490    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668495    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668500    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668504    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668509    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668513    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668518    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668523    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668527    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668532    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668536    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668541    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668546    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668550    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.672287 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668554    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668559    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668563    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668568    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668572    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668577    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668581    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668588    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668595    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668601    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668606    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668610    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668615    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668621    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668626    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668631    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668635    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668640    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668645    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668650    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.672959 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668655    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668660    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668664    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668669    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668673    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668678    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668683    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668687    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668691    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668697    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668703    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668708    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668713    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668719    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668725    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668731    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668735    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668740    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668744    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.673639 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668750    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668755    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668759    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668764    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668769    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668773    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668778    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668784    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668789    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668794    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668799    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668803    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668808    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668812    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668817    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.674183 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.668822    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.668831    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669061    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669069    2577 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669075    2577 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669080    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669085    2577 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669090    2577 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669095    2577 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669100    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669104    2577 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669109    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669113    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669118    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669122    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 16 17:32:55.674589 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669127    2577 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669133    2577 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669140    2577 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669145    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669150    2577 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669155    2577 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669159    2577 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669163    2577 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669168    2577 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669172    2577 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669178    2577 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669182    2577 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669187    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669192    2577 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669196    2577 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669201    2577 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669205    2577 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669209    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669214    2577 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 16 17:32:55.675046 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669219    2577 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669224    2577 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669228    2577 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669233    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669237    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669242    2577 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669247    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669251    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669256    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669260    2577 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669265    2577 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669270    2577 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669274    2577 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669279    2577 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669283    2577 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669288    2577 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669293    2577 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669297    2577 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669301    2577 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669306    2577 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 16 17:32:55.675549 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669311    2577 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669315    2577 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669320    2577 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669325    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669333    2577 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669340    2577 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669344    2577 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669349    2577 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669354    2577 feature_gate.go:328] unrecognized feature gate: Example
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669359    2577 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669382    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669387    2577 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669392    2577 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669396    2577 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669400    2577 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669405    2577 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669409    2577 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669414    2577 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669419    2577 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 16 17:32:55.676085 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669423    2577 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669427    2577 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669433    2577 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669437    2577 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669441    2577 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669446    2577 feature_gate.go:328] unrecognized feature gate: Example2
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669450    2577 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669454    2577 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669459    2577 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669464    2577 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669468    2577 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669475    2577 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669481    2577 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669486    2577 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669491    2577 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669496    2577 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669501    2577 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669506    2577 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669512    2577 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669517    2577 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 16 17:32:55.676813 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669522    2577 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669527    2577 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669532    2577 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669536    2577 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669541    2577 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669545    2577 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669550    2577 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:55.669554    2577 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.669563    2577 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.669703    2577 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.672495    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.673920    2577 server.go:1019] "Starting client certificate rotation"
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.674080    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:32:55.677708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.674118    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 16 17:32:55.678308 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.677135    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:32:55.679590 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.679561    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 16 17:32:55.689461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.689439    2577 log.go:25] "Validated CRI v1 runtime API"
Jul 16 17:32:55.691817 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.691800    2577 log.go:25] "Validated CRI v1 image API"
Jul 16 17:32:55.692714 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.692692    2577 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 16 17:32:55.695267 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.695246    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 efe2770b-2fe9-4266-b4ee-d81fc182a122:/dev/nvme0n1p4 fded5db4-3c5b-47b0-86c8-7e00026033a5:/dev/nvme0n1p3]
Jul 16 17:32:55.695333 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.695267    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 16 17:32:55.701591 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.701482    2577 manager.go:216] Machine: {Timestamp:2026-07-16 17:32:55.699060804 +0000 UTC m=+0.343283676 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099086 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec27cc8a636c6eb9663668a5704e5bf2 SystemUUID:ec27cc8a-636c-6eb9-6636-68a5704e5bf2 BootID:d4f02581-3672-41eb-a3ac-ad7cf42f4d7a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:2a:b1:21:73 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:2a:b1:21:73 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:44:ac:af:17:67 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 16 17:32:55.701591 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.701586    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 16 17:32:55.701706 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.701661    2577 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 16 17:32:55.704604 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.704583    2577 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 16 17:32:55.704760 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.704607    2577 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-76.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 16 17:32:55.705426 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.705415    2577 topology_manager.go:138] "Creating topology manager with none policy"
Jul 16 17:32:55.705461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.705428    2577 container_manager_linux.go:309] "Creating device plugin manager"
Jul 16 17:32:55.705461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.705436    2577 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:32:55.706022 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.706012    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 16 17:32:55.708017 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.708006    2577 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 16 17:32:55.712008 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.711996    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:32:55.712155 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712145    2577 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 16 17:32:55.712199 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712177    2577 kubelet.go:486] "Attempting to sync node with API server"
Jul 16 17:32:55.712199 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712187    2577 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 16 17:32:55.712266 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712202    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 16 17:32:55.712266 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712212    2577 kubelet.go:398] "Adding apiserver pod source"
Jul 16 17:32:55.712266 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712221    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 16 17:32:55.712570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712558    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:32:55.712609 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.712580    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 16 17:32:55.713037 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.713014    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:32:55.715502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.715483    2577 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 16 17:32:55.717552 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717536    2577 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 16 17:32:55.717614 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717569    2577 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 16 17:32:55.717729 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717718    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 16 17:32:55.717767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717733    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 16 17:32:55.717767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717740    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 16 17:32:55.717767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717745    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 16 17:32:55.717767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717754    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 16 17:32:55.717767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.717760    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 16 17:32:55.718454 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718444    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 16 17:32:55.718454 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718454    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 16 17:32:55.718536 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718462    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 16 17:32:55.718536 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718469    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 16 17:32:55.718536 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718478    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 16 17:32:55.718536 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.718487    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 16 17:32:55.719471 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.719459    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 16 17:32:55.719471 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.719471    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 16 17:32:55.723122 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.723107    2577 server.go:1268] "Started kubelet"
Jul 16 17:32:55.723246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.723198    2577 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 16 17:32:55.723246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.723197    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 16 17:32:55.723315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.723275    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 16 17:32:55.724030 ip-10-0-137-76 systemd[1]: Started Kubernetes Kubelet.
Jul 16 17:32:55.726718 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.726693    2577 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 16 17:32:55.727813 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.727780    2577 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 16 17:32:55.728959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.728933    2577 server.go:310] "Adding debug handlers to kubelet server"
Jul 16 17:32:55.730453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.730428    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-76.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 16 17:32:55.730453 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.730433    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 16 17:32:55.730560 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.730492    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 16 17:32:55.733901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.733646    2577 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 16 17:32:55.734271 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734251    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 16 17:32:55.734351 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.734313    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:55.734429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734402    2577 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 16 17:32:55.734429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734418    2577 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 16 17:32:55.734526 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734499    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 16 17:32:55.734579 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734570    2577 reconstruct.go:97] "Volume reconstruction finished"
Jul 16 17:32:55.734579 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.734578    2577 reconciler.go:29] "Reconciler: start to sync state"
Jul 16 17:32:55.735126 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735095    2577 factory.go:55] Registering systemd factory
Jul 16 17:32:55.735126 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735114    2577 factory.go:223] Registration of the systemd container factory successfully
Jul 16 17:32:55.735418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735400    2577 factory.go:153] Registering CRI-O factory
Jul 16 17:32:55.735418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735417    2577 factory.go:223] Registration of the crio container factory successfully
Jul 16 17:32:55.735523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735469    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 16 17:32:55.735523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735491    2577 factory.go:103] Registering Raw factory
Jul 16 17:32:55.735523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.735502    2577 manager.go:1196] Started watching for new ooms in manager
Jul 16 17:32:55.736116 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.736094    2577 manager.go:349] Starting recovery of all containers
Jul 16 17:32:55.736331 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.736287    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 16 17:32:55.737373 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.736042    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-76.ec2.internal.18c2d5866cfe5b52  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-76.ec2.internal,UID:ip-10-0-137-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-76.ec2.internal,},FirstTimestamp:2026-07-16 17:32:55.72308053 +0000 UTC m=+0.367303402,LastTimestamp:2026-07-16 17:32:55.72308053 +0000 UTC m=+0.367303402,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-76.ec2.internal,}"
Jul 16 17:32:55.741152 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.741124    2577 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-76.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 16 17:32:55.741939 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.741914    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4g4h5"
Jul 16 17:32:55.746593 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.746573    2577 manager.go:354] Recovery completed
Jul 16 17:32:55.751468 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.751337    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:55.753291 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753274    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:55.753368 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753308    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:55.753368 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753322    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:55.753737 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753719    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4g4h5"
Jul 16 17:32:55.753931 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753916    2577 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 16 17:32:55.754004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753933    2577 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 16 17:32:55.754004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753950    2577 state_mem.go:36] "Initialized new in-memory state store"
Jul 16 17:32:55.754004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.753917    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:55.755203 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.755185    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:55.755283 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.755213    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:55.755283 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.755229    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:55.755425 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.755340    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-76.ec2.internal.18c2d5866ecb5078  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-76.ec2.internal,UID:ip-10-0-137-76.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-76.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-76.ec2.internal,},FirstTimestamp:2026-07-16 17:32:55.753289848 +0000 UTC m=+0.397512724,LastTimestamp:2026-07-16 17:32:55.753289848 +0000 UTC m=+0.397512724,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-76.ec2.internal,}"
Jul 16 17:32:55.756193 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.756181    2577 policy_none.go:49] "None policy: Start"
Jul 16 17:32:55.756244 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.756198    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 16 17:32:55.756244 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.756209    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 16 17:32:55.758202 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.758191    2577 policy_none.go:47] "Start"
Jul 16 17:32:55.795940 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.795922    2577 manager.go:337] "Starting Device Plugin manager"
Jul 16 17:32:55.796015 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.795953    2577 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 16 17:32:55.796015 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.795962    2577 server.go:87] "Starting device plugin registration server"
Jul 16 17:32:55.796173 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.796160    2577 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 16 17:32:55.796226 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.796175    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 16 17:32:55.796334 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.796296    2577 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 16 17:32:55.796435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.796404    2577 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 16 17:32:55.796435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.796414    2577 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 16 17:32:55.796884 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.796862    2577 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 16 17:32:55.796956 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.796914    2577 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:55.896385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.896358    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:55.898694 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.897224    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:55.898694 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.897253    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:55.898694 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.897265    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:55.898694 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.897296    2577 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-76.ec2.internal"
Jul 16 17:32:55.907270 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.907252    2577 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-76.ec2.internal"
Jul 16 17:32:55.907317 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.907277    2577 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-76.ec2.internal\": node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:55.915014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.914992    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 16 17:32:55.916145 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.916125    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 16 17:32:55.916241 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.916160    2577 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 16 17:32:55.916241 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.916180    2577 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 16 17:32:55.916241 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.916209    2577 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 16 17:32:55.918324 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:55.918296    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:55.923316 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:55.923299    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.016636 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.016595    2577 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"]
Jul 16 17:32:56.016765 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.016673    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:56.017563 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.017547    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:56.017636 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.017575    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:56.017636 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.017585    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:56.020026 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.020008    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:56.020159 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.020145    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.020202 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.020185    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:56.022455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022438    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:56.022455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022452    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:56.022585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022462    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:56.022585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022473    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:56.022585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022477    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:56.022585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.022489    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:56.023778 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.023757    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.024798 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.024781    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.024885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.024806    2577 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 16 17:32:56.025536 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.025521    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientMemory"
Jul 16 17:32:56.025614 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.025545    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasNoDiskPressure"
Jul 16 17:32:56.025614 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.025555    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeHasSufficientPID"
Jul 16 17:32:56.036466 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.036446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.036558 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.036475    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.036558 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.036494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a740f5ec7352c6c6e3423deebd004375-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"a740f5ec7352c6c6e3423deebd004375\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.042953 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.042936    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-76.ec2.internal\" not found" node="ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.046999 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.046983    2577 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-76.ec2.internal\" not found" node="ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.124301 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.124277    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.137356 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137329    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.137453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.137453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a740f5ec7352c6c6e3423deebd004375-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"a740f5ec7352c6c6e3423deebd004375\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.137532 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137453    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.137532 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137455    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d06558539c53a8377132ff5ed4bfaf27-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal\" (UID: \"d06558539c53a8377132ff5ed4bfaf27\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.137532 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.137497    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a740f5ec7352c6c6e3423deebd004375-config\") pod \"kube-apiserver-proxy-ip-10-0-137-76.ec2.internal\" (UID: \"a740f5ec7352c6c6e3423deebd004375\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.224755 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.224694    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.331959 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.331919    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.345285 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.345267    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.350577 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.350499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:56.433111 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.433074    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.540690 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.540605    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.640818 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.640789    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.644053 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.644036    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:56.673174 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.673153    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 16 17:32:56.673606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.673270    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:32:56.673606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.673335    2577 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 16 17:32:56.741799 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.741758    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.758091 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.758058    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 17:27:56 +0000 UTC" deadline="2028-01-26 18:00:45.186880592 +0000 UTC"
Jul 16 17:32:56.758091 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.758087    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13416h27m48.428797265s"
Jul 16 17:32:56.842808 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.842750    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.943124 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:56.943093    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:56.986583 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:56.986543    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06558539c53a8377132ff5ed4bfaf27.slice/crio-e41cd884ae149c9b51cd8e3496eda6aae4706d0a5a4a56cf3fd6c642a5ffed3c WatchSource:0}: Error finding container e41cd884ae149c9b51cd8e3496eda6aae4706d0a5a4a56cf3fd6c642a5ffed3c: Status 404 returned error can't find the container with id e41cd884ae149c9b51cd8e3496eda6aae4706d0a5a4a56cf3fd6c642a5ffed3c
Jul 16 17:32:56.987052 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:56.987031    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda740f5ec7352c6c6e3423deebd004375.slice/crio-cee4732823633d9905c6d12eaaceeb3a4a81a1069940c04b5d44b0cb4e8c82e3 WatchSource:0}: Error finding container cee4732823633d9905c6d12eaaceeb3a4a81a1069940c04b5d44b0cb4e8c82e3: Status 404 returned error can't find the container with id cee4732823633d9905c6d12eaaceeb3a4a81a1069940c04b5d44b0cb4e8c82e3
Jul 16 17:32:56.993896 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:56.993880    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:32:57.044140 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.044101    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:57.145243 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.145164    2577 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-76.ec2.internal\" not found"
Jul 16 17:32:57.152568 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.152549    2577 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:57.229724 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.229702    2577 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:57.235534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.235515    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:57.248693 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.248674    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:32:57.249947 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.249934    2577 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal"
Jul 16 17:32:57.260505 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.260488    2577 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 16 17:32:57.713060 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.713014    2577 apiserver.go:52] "Watching apiserver"
Jul 16 17:32:57.722410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.722383    2577 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 16 17:32:57.722979 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.722953    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-q7pt8","kube-system/konnectivity-agent-gdnxt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n","openshift-dns/node-resolver-rgxwx","openshift-multus/multus-additional-cni-plugins-5k8wp","openshift-multus/multus-hjxjg","openshift-multus/network-metrics-daemon-zq475","kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal","openshift-cluster-node-tuning-operator/tuned-st246","openshift-image-registry/node-ca-k6vc5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal","openshift-network-diagnostics/network-check-target-csmrc","openshift-network-operator/iptables-alerter-twj5p","openshift-ovn-kubernetes/ovnkube-node-8bk6d"]
Jul 16 17:32:57.726062 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.726042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.726165 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.726128    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:32:57.728443 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.728423    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.733077 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.732449    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.734518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.733767    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735028    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735299    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tz2c9\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735507    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735551    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735507    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z8lwh\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735758    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735859    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.735933    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.736073    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 16 17:32:57.736978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.736197    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.738211 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.738190    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.738796 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.738749    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.738906 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.738816    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.738906 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.738864    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jfrh9\""
Jul 16 17:32:57.740759 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.740738    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.741354 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741334    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 16 17:32:57.741446 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741432    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 16 17:32:57.741512 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741449    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 16 17:32:57.741586 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741564    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 16 17:32:57.741726 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741707    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.741805 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741793    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-frhwv\""
Jul 16 17:32:57.741925 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.741909    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlj96\""
Jul 16 17:32:57.742165 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.742010    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.744163 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.743247    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.744163 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.743254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.744163 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.743426    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:32:57.747059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.744632    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.747059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.744783    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tjzhr\""
Jul 16 17:32:57.747059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.746432    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748176    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748261    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-socket-dir-parent\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748308    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-bin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748343    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcsrr\" (UniqueName: \"kubernetes.io/projected/a77096c1-aac2-46ec-8239-b2515f2b081a-kube-api-access-dcsrr\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748556    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748591    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-cnibin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748625    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-cni-binary-copy\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748655    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-conf-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748693    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-multus-certs\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748820    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a33695a-6bc6-418a-a646-8f1b25211151-iptables-alerter-script\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.748864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-os-release\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-k8s-cni-cncf-io\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748942    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2mzf\" (UniqueName: \"kubernetes.io/projected/fff13d95-11f7-4a89-b299-3eef19f2f823-kube-api-access-b2mzf\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.748973    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-sys-fs\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749010    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qf7s\" (UniqueName: \"kubernetes.io/projected/2a33695a-6bc6-418a-a646-8f1b25211151-kube-api-access-9qf7s\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-socket-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmwsp\" (UniqueName: \"kubernetes.io/projected/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kube-api-access-fmwsp\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749129    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-cnibin\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749176    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-multus\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749204    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-hosts-file\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.749493 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-tmp-dir\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749538    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749575    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-daemon-config\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749640    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749683    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a33695a-6bc6-418a-a646-8f1b25211151-host-slash\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749724    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-registration-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-os-release\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749817    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-netns\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-hostroot\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749888    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-system-cni-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749929    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749963    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-system-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.749991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-device-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbnz5\" (UniqueName: \"kubernetes.io/projected/46e61a52-2b88-4c58-9d32-70b6e32e35da-kube-api-access-zbnz5\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750235    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-kubelet\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750263    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-etc-kubernetes\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.750582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750295    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qww4s\" (UniqueName: \"kubernetes.io/projected/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-kube-api-access-qww4s\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.750883 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.750861    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 16 17:32:57.752140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.751333    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qlk7n\""
Jul 16 17:32:57.752140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.751524    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 16 17:32:57.752140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.751704    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.752140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.751955    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.752140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.751974    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 16 17:32:57.752486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.752294    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.752486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.752330    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2mngw\""
Jul 16 17:32:57.754948 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.754797    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 16 17:32:57.755055 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755009    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 16 17:32:57.755119 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755055    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 16 17:32:57.755584 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755564    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 16 17:32:57.755734 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755714    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:57.755813 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.755781    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:32:57.755918 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755900    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9d7w5\""
Jul 16 17:32:57.755986 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.755942    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 16 17:32:57.756042 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.756020    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 16 17:32:57.756528 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.756508    2577 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 16 17:32:57.779478 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.779456    2577 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nb4r9"
Jul 16 17:32:57.789304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.789067    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nb4r9"
Jul 16 17:32:57.836631 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.836605    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850665    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-device-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850748    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850769    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-device-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbnz5\" (UniqueName: \"kubernetes.io/projected/46e61a52-2b88-4c58-9d32-70b6e32e35da-kube-api-access-zbnz5\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850833    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-kubelet\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-modprobe-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-var-lib-kubelet\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850922    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-bin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.850976    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-cnibin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851040    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-cni-binary-copy\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851065    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-multus-certs\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-tuned\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851124    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vtl7\" (UniqueName: \"kubernetes.io/projected/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-kube-api-access-2vtl7\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.852785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851155    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bd8g\" (UniqueName: \"kubernetes.io/projected/13062e48-bf9d-49e5-880b-af8dd4584637-kube-api-access-5bd8g\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851181    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-systemd-units\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851209    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a33695a-6bc6-418a-a646-8f1b25211151-iptables-alerter-script\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851236    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-k8s-cni-cncf-io\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851262    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-conf\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851297    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-tmp\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-kubelet-config\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851366    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-ovn\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851410    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-sys-fs\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-socket-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851477    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-cnibin\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851479    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-run\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851528    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-lib-modules\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851564    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-multus-certs\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851665    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovn-node-metrics-cert\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.853775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851698    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-hosts-file\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851809    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-daemon-config\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851836    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-sys\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851863    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-slash\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851877    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-cni-binary-copy\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851898    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-node-log\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851951    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-bin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.851961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-kubelet\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-hosts-file\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852128    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-script-lib\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852132    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-etc-selinux\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852135    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2a33695a-6bc6-418a-a646-8f1b25211151-iptables-alerter-script\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-cnibin\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852007    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852242    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-sys-fs\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852253    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-cnibin\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.854861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852307    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a33695a-6bc6-418a-a646-8f1b25211151-host-slash\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852344    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852197    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-k8s-cni-cncf-io\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852422    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a33695a-6bc6-418a-a646-8f1b25211151-host-slash\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.852459    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852501    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-hostroot\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.852558    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:32:58.352520767 +0000 UTC m=+2.996743649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852559    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-hostroot\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-kubernetes\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-socket-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-env-overrides\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852620    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-daemon-config\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852663    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-system-cni-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852703    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852753    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-system-cni-dir\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-systemd\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.855844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852873    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-dbus\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852904    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-systemd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-etc-kubernetes\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.852993    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-etc-kubernetes\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qww4s\" (UniqueName: \"kubernetes.io/projected/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-kube-api-access-qww4s\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-socket-dir-parent\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853114    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853165    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-host\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-socket-dir-parent\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-netns\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853241    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853322    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853362    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-bin\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-netd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853418    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcsrr\" (UniqueName: \"kubernetes.io/projected/a77096c1-aac2-46ec-8239-b2515f2b081a-kube-api-access-dcsrr\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853444    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853470    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-conf-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.856713 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-agent-certs\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853517    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13062e48-bf9d-49e5-880b-af8dd4584637-serviceca\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-os-release\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853567    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2mzf\" (UniqueName: \"kubernetes.io/projected/fff13d95-11f7-4a89-b299-3eef19f2f823-kube-api-access-b2mzf\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853594    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qf7s\" (UniqueName: \"kubernetes.io/projected/2a33695a-6bc6-418a-a646-8f1b25211151-kube-api-access-9qf7s\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853621    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmwsp\" (UniqueName: \"kubernetes.io/projected/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kube-api-access-fmwsp\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853650    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-multus\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853675    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbht8\" (UniqueName: \"kubernetes.io/projected/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-kube-api-access-jbht8\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853700    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853726    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-tmp-dir\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853752    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853776    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-kubelet\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853801    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-var-lib-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-etc-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853847    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-log-socket\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.857740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-config\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853926    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46e61a52-2b88-4c58-9d32-70b6e32e35da-os-release\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853930    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-registration-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-os-release\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-registration-dir\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854001    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46e61a52-2b88-4c58-9d32-70b6e32e35da-cni-binary-copy\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854017    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-netns\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-var-lib-cni-multus\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854046    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-konnectivity-ca\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.853676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-multus-conf-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-host-run-netns\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854133    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13062e48-bf9d-49e5-880b-af8dd4584637-host\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854184    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-system-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysconfig\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854320    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-tmp-dir\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854342    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-os-release\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.858574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.854426    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fff13d95-11f7-4a89-b299-3eef19f2f823-system-cni-dir\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.859397 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.859257    2577 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 16 17:32:57.864918 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.864894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbnz5\" (UniqueName: \"kubernetes.io/projected/46e61a52-2b88-4c58-9d32-70b6e32e35da-kube-api-access-zbnz5\") pod \"multus-additional-cni-plugins-5k8wp\" (UID: \"46e61a52-2b88-4c58-9d32-70b6e32e35da\") " pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:57.870270 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.870220    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qf7s\" (UniqueName: \"kubernetes.io/projected/2a33695a-6bc6-418a-a646-8f1b25211151-kube-api-access-9qf7s\") pod \"iptables-alerter-twj5p\" (UID: \"2a33695a-6bc6-418a-a646-8f1b25211151\") " pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:57.870430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.870266    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcsrr\" (UniqueName: \"kubernetes.io/projected/a77096c1-aac2-46ec-8239-b2515f2b081a-kube-api-access-dcsrr\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:57.870430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.870276    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmwsp\" (UniqueName: \"kubernetes.io/projected/a9c7cfbc-d4cc-4dac-a0f6-03825ae26109-kube-api-access-fmwsp\") pod \"aws-ebs-csi-driver-node-zpr7n\" (UID: \"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:57.870924 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.870901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2mzf\" (UniqueName: \"kubernetes.io/projected/fff13d95-11f7-4a89-b299-3eef19f2f823-kube-api-access-b2mzf\") pod \"multus-hjxjg\" (UID: \"fff13d95-11f7-4a89-b299-3eef19f2f823\") " pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:57.873928 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.873880    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qww4s\" (UniqueName: \"kubernetes.io/projected/8d11b391-c98d-4cbb-a53a-d32cd4dc8c92-kube-api-access-qww4s\") pod \"node-resolver-rgxwx\" (UID: \"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92\") " pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:57.922618 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.922558    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" event={"ID":"a740f5ec7352c6c6e3423deebd004375","Type":"ContainerStarted","Data":"cee4732823633d9905c6d12eaaceeb3a4a81a1069940c04b5d44b0cb4e8c82e3"}
Jul 16 17:32:57.924173 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.924136    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"d06558539c53a8377132ff5ed4bfaf27","Type":"ContainerStarted","Data":"e41cd884ae149c9b51cd8e3496eda6aae4706d0a5a4a56cf3fd6c642a5ffed3c"}
Jul 16 17:32:57.954594 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.954739 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-kubelet\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.954739 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-var-lib-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.954739 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954641    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-etc-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.954739 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954701    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-etc-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.954739 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-kubelet\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954749    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-var-lib-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.954811    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954844    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-log-socket\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.954871    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:58.454851035 +0000 UTC m=+3.099073900 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954898    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-log-socket\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954902    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954931    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-config\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.954961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-konnectivity-ca\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955021    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955068    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13062e48-bf9d-49e5-880b-af8dd4584637-host\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955100    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysconfig\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955135    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-modprobe-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955159    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-var-lib-kubelet\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-tuned\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vtl7\" (UniqueName: \"kubernetes.io/projected/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-kube-api-access-2vtl7\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955221    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysconfig\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955241    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bd8g\" (UniqueName: \"kubernetes.io/projected/13062e48-bf9d-49e5-880b-af8dd4584637-kube-api-access-5bd8g\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955268    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-systemd-units\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955275    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/13062e48-bf9d-49e5-880b-af8dd4584637-host\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955294    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-conf\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-tmp\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-kubelet-config\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955388    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-ovn\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955415    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-run\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-lib-modules\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.955461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955463    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955488    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovn-node-metrics-cert\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-sys\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955538    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-slash\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-node-log\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955587    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-script-lib\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955594    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-config\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-kubernetes\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955658    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-env-overrides\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955686    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-systemd\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955693    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-konnectivity-ca\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955703    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-var-lib-kubelet\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955720    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-dbus\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955732    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-modprobe-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955746    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-systemd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955778    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-systemd-units\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955783    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-node-log\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.956374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955824    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-host\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955851    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-netns\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955887    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955897    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-lib-modules\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-d\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955937    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-netns\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955983    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-host\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.955985    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-openvswitch\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956038    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-slash\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956084    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-ovn\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956081    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-sysctl-conf\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-kubelet-config\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956188    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-bin\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-netd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956245    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-agent-certs\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13062e48-bf9d-49e5-880b-af8dd4584637-serviceca\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbht8\" (UniqueName: \"kubernetes.io/projected/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-kube-api-access-jbht8\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956323    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:57.957304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovnkube-script-lib\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956505    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-env-overrides\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956564    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-systemd\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-kubernetes\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956603    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-bin\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956624    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-run-systemd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-run\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956656    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-cni-netd\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956678    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.956720    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/527be017-dd6d-4ba2-9799-353afac35e75-dbus\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.957034    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-sys\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.958210 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.957131    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/13062e48-bf9d-49e5-880b-af8dd4584637-serviceca\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.958763 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.958709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-ovn-node-metrics-cert\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:57.959863 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.959826    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-tmp\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.960460 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.960414    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-etc-tuned\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.960667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.960615    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9b442b11-cb9c-4bac-87fa-8a7b1411f2bf-agent-certs\") pod \"konnectivity-agent-gdnxt\" (UID: \"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf\") " pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:57.969018 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.968962    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vtl7\" (UniqueName: \"kubernetes.io/projected/2a867c14-e6d3-4bce-ab09-4f2b30ccca41-kube-api-access-2vtl7\") pod \"tuned-st246\" (UID: \"2a867c14-e6d3-4bce-ab09-4f2b30ccca41\") " pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:57.971648 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.971625    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:32:57.971648 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.971651    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:32:57.971648 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.971665    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:57.971884 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:57.971722    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:58.471706621 +0000 UTC m=+3.115929497 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:57.973983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.973958    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bd8g\" (UniqueName: \"kubernetes.io/projected/13062e48-bf9d-49e5-880b-af8dd4584637-kube-api-access-5bd8g\") pod \"node-ca-k6vc5\" (UID: \"13062e48-bf9d-49e5-880b-af8dd4584637\") " pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:57.974732 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:57.974712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbht8\" (UniqueName: \"kubernetes.io/projected/a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c-kube-api-access-jbht8\") pod \"ovnkube-node-8bk6d\" (UID: \"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:58.050472 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.050439    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-twj5p"
Jul 16 17:32:58.061908 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.061881    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n"
Jul 16 17:32:58.071721 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.071693    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rgxwx"
Jul 16 17:32:58.078617 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.078597    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5k8wp"
Jul 16 17:32:58.086422 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.086403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hjxjg"
Jul 16 17:32:58.096169 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.096151    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-st246"
Jul 16 17:32:58.105000 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.104983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:32:58.112878 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.112858    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-k6vc5"
Jul 16 17:32:58.119606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.119589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:32:58.133903 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.133884    2577 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:58.359157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.359081    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:58.359298 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.359213    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:58.359298 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.359293    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:32:59.359258972 +0000 UTC m=+4.003481833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:58.460186 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.460158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:58.460372 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.460288    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:58.460372 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.460369    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:59.460352341 +0000 UTC m=+4.104575201 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:58.561142 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.561095    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:58.561353 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.561265    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:32:58.561353 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.561289    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:32:58.561353 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.561302    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:58.561538 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:58.561386    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:32:59.561365663 +0000 UTC m=+4.205588522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:58.792456 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.792371    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:27:58 +0000 UTC" deadline="2028-03-30 11:02:58.539677584 +0000 UTC"
Jul 16 17:32:58.792456 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:58.792405    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14945h29m59.747275915s"
Jul 16 17:32:59.079869 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.079841    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d11b391_c98d_4cbb_a53a_d32cd4dc8c92.slice/crio-c9ed26451167994c781b5d9ca9cf210d267aa9c201305000492b6b5ed142e3f1 WatchSource:0}: Error finding container c9ed26451167994c781b5d9ca9cf210d267aa9c201305000492b6b5ed142e3f1: Status 404 returned error can't find the container with id c9ed26451167994c781b5d9ca9cf210d267aa9c201305000492b6b5ed142e3f1
Jul 16 17:32:59.080876 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.080843    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b442b11_cb9c_4bac_87fa_8a7b1411f2bf.slice/crio-863a9ac6dd06f6a2b9a9f2ede64d57045e13ad182e1b56d54f5f39546a7310e9 WatchSource:0}: Error finding container 863a9ac6dd06f6a2b9a9f2ede64d57045e13ad182e1b56d54f5f39546a7310e9: Status 404 returned error can't find the container with id 863a9ac6dd06f6a2b9a9f2ede64d57045e13ad182e1b56d54f5f39546a7310e9
Jul 16 17:32:59.082376 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.082192    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46e61a52_2b88_4c58_9d32_70b6e32e35da.slice/crio-756a92fe00d72e556523da3bb206f66fe91f4212b0d513db89da024472049cf8 WatchSource:0}: Error finding container 756a92fe00d72e556523da3bb206f66fe91f4212b0d513db89da024472049cf8: Status 404 returned error can't find the container with id 756a92fe00d72e556523da3bb206f66fe91f4212b0d513db89da024472049cf8
Jul 16 17:32:59.091420 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.091389    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13062e48_bf9d_49e5_880b_af8dd4584637.slice/crio-b8d16dbb9f81ec98502a5e67819fdb71f999bb3a34d39474698e5e5adb93fd55 WatchSource:0}: Error finding container b8d16dbb9f81ec98502a5e67819fdb71f999bb3a34d39474698e5e5adb93fd55: Status 404 returned error can't find the container with id b8d16dbb9f81ec98502a5e67819fdb71f999bb3a34d39474698e5e5adb93fd55
Jul 16 17:32:59.092742 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.092715    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a0d4fd_dc77_45cd_bca0_919bcbf3e89c.slice/crio-2becb52517c45b47f9d7f95b23a0e62765abfefcb59fd58b5b55abf74ae5b4af WatchSource:0}: Error finding container 2becb52517c45b47f9d7f95b23a0e62765abfefcb59fd58b5b55abf74ae5b4af: Status 404 returned error can't find the container with id 2becb52517c45b47f9d7f95b23a0e62765abfefcb59fd58b5b55abf74ae5b4af
Jul 16 17:32:59.093758 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.093738    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a867c14_e6d3_4bce_ab09_4f2b30ccca41.slice/crio-a7de81c81c9cc73cc6af3b54d078304c599badc9ec3cfbf967c6dc664c65a476 WatchSource:0}: Error finding container a7de81c81c9cc73cc6af3b54d078304c599badc9ec3cfbf967c6dc664c65a476: Status 404 returned error can't find the container with id a7de81c81c9cc73cc6af3b54d078304c599badc9ec3cfbf967c6dc664c65a476
Jul 16 17:32:59.095714 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.095628    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c7cfbc_d4cc_4dac_a0f6_03825ae26109.slice/crio-c554dd3978dc5a7bc4447549c790ed0f45ebb0ae48f7513d6de450f27a46def0 WatchSource:0}: Error finding container c554dd3978dc5a7bc4447549c790ed0f45ebb0ae48f7513d6de450f27a46def0: Status 404 returned error can't find the container with id c554dd3978dc5a7bc4447549c790ed0f45ebb0ae48f7513d6de450f27a46def0
Jul 16 17:32:59.097059 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:32:59.096915    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff13d95_11f7_4a89_b299_3eef19f2f823.slice/crio-d033eb3de0fc64fab18f78dc3f9d6baf6a382c5630a3c43e0d851ddfc271b067 WatchSource:0}: Error finding container d033eb3de0fc64fab18f78dc3f9d6baf6a382c5630a3c43e0d851ddfc271b067: Status 404 returned error can't find the container with id d033eb3de0fc64fab18f78dc3f9d6baf6a382c5630a3c43e0d851ddfc271b067
Jul 16 17:32:59.370491 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.370277    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:59.370609 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.370437    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:59.370609 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.370562    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:01.370541624 +0000 UTC m=+6.014764497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:32:59.471392 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.471353    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:59.471573 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.471552    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:59.471639 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.471628    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:01.471609902 +0000 UTC m=+6.115832760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:32:59.572241 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.572136    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:59.572416 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.572321    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:32:59.572416 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.572345    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:32:59.572416 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.572356    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:59.572532 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.572424    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:01.57240429 +0000 UTC m=+6.216627148 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:32:59.735418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.735357    2577 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 16 17:32:59.792674 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.792591    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 17:27:58 +0000 UTC" deadline="2028-03-28 05:58:21.225965698 +0000 UTC"
Jul 16 17:32:59.792674 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.792646    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14892h25m21.433324501s"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.917379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.917362    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.917527    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.917527    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.917599    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:32:59.918014 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:32:59.917671    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:32:59.933068 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.933034    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" event={"ID":"a740f5ec7352c6c6e3423deebd004375","Type":"ContainerStarted","Data":"188560a6507dd6497772cd6b6cebd63b9bbbbad34a3be9b5f56bef129c431f0c"}
Jul 16 17:32:59.942621 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.942463    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"2becb52517c45b47f9d7f95b23a0e62765abfefcb59fd58b5b55abf74ae5b4af"}
Jul 16 17:32:59.945809 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.945741    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st246" event={"ID":"2a867c14-e6d3-4bce-ab09-4f2b30ccca41","Type":"ContainerStarted","Data":"a7de81c81c9cc73cc6af3b54d078304c599badc9ec3cfbf967c6dc664c65a476"}
Jul 16 17:32:59.949649 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.949611    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6vc5" event={"ID":"13062e48-bf9d-49e5-880b-af8dd4584637","Type":"ContainerStarted","Data":"b8d16dbb9f81ec98502a5e67819fdb71f999bb3a34d39474698e5e5adb93fd55"}
Jul 16 17:32:59.955316 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.955236    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerStarted","Data":"756a92fe00d72e556523da3bb206f66fe91f4212b0d513db89da024472049cf8"}
Jul 16 17:32:59.956592 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.956563    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdnxt" event={"ID":"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf","Type":"ContainerStarted","Data":"863a9ac6dd06f6a2b9a9f2ede64d57045e13ad182e1b56d54f5f39546a7310e9"}
Jul 16 17:32:59.959324 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.959268    2577 generic.go:356] "Generic (PLEG): container finished" podID="d06558539c53a8377132ff5ed4bfaf27" containerID="1cd005c6287c1bd70625c893ae71443bd5cbdb2f11b9b0c8b20abd6fbea18681" exitCode=0
Jul 16 17:32:59.959453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.959345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"d06558539c53a8377132ff5ed4bfaf27","Type":"ContainerDied","Data":"1cd005c6287c1bd70625c893ae71443bd5cbdb2f11b9b0c8b20abd6fbea18681"}
Jul 16 17:32:59.962291 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.962266    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hjxjg" event={"ID":"fff13d95-11f7-4a89-b299-3eef19f2f823","Type":"ContainerStarted","Data":"d033eb3de0fc64fab18f78dc3f9d6baf6a382c5630a3c43e0d851ddfc271b067"}
Jul 16 17:32:59.964408 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.964214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n" event={"ID":"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109","Type":"ContainerStarted","Data":"c554dd3978dc5a7bc4447549c790ed0f45ebb0ae48f7513d6de450f27a46def0"}
Jul 16 17:32:59.967898 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.967872    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twj5p" event={"ID":"2a33695a-6bc6-418a-a646-8f1b25211151","Type":"ContainerStarted","Data":"44c9aac9e3a2a67ddea9548ba3513e164ac782de7ead60772f7d98ffc0111be0"}
Jul 16 17:32:59.972725 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.972701    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rgxwx" event={"ID":"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92","Type":"ContainerStarted","Data":"c9ed26451167994c781b5d9ca9cf210d267aa9c201305000492b6b5ed142e3f1"}
Jul 16 17:32:59.984258 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:32:59.984204    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-76.ec2.internal" podStartSLOduration=2.9841863760000003 podStartE2EDuration="2.984186376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:32:59.954808551 +0000 UTC m=+4.599031435" watchObservedRunningTime="2026-07-16 17:32:59.984186376 +0000 UTC m=+4.628409260"
Jul 16 17:33:00.990705 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:00.990641    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" event={"ID":"d06558539c53a8377132ff5ed4bfaf27","Type":"ContainerStarted","Data":"05d5403ed65feb1409cdac0bef05a4af752550ec7756dee13c5f72ed6b134f9c"}
Jul 16 17:33:01.389589 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.389469    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:01.389746 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.389660    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:01.389746 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.389723    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.389702961 +0000 UTC m=+10.033925822 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:01.490582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.490541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:01.490776 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.490763    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:01.490846 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.490825    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.490804954 +0000 UTC m=+10.135027820 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:01.591425 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.591384    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:01.591644 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.591624    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:33:01.591724 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.591652    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:33:01.591724 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.591665    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:01.591835 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.591722    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:05.59170409 +0000 UTC m=+10.235926949 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:01.916858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.916818    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:01.917055 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.916957    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:01.917400 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.917381    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:01.917510 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.917491    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:01.917572 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:01.917557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:01.917652 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:01.917629    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:03.918205 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:03.918170    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:03.918666 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:03.918354    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:03.918666 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:03.918403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:03.918666 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:03.918483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:03.918666 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:03.918605    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:03.918862 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:03.918696    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:05.421509 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.421166    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:05.421509 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.421332    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:05.421509 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.421397    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:13.42137735 +0000 UTC m=+18.065600208 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:05.522349 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.522310    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:05.522519 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.522461    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:05.522595 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.522526    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:13.522507592 +0000 UTC m=+18.166730453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:05.622981 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.622942    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:05.623156 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.623123    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:33:05.623156 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.623147    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:33:05.623270 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.623159    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:05.623270 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.623223    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:13.62320549 +0000 UTC m=+18.267428367 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.918007    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.918130    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.918511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.918611    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:05.918667    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:05.918822 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:05.918731    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:07.921192 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:07.921159    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:07.921702 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:07.921350    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:07.921702 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:07.921431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:07.921702 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:07.921543    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:07.921702 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:07.921603    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:07.921702 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:07.921670    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:09.918997 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:09.918945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:09.918997 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:09.918982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:09.919423 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:09.919045    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:09.919423 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:09.919059    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:09.919423 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:09.919142    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:09.919423 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:09.919235    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:11.917471 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:11.917436    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:11.917471 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:11.917474    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:11.917967 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:11.917440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:11.917967 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:11.917564    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:11.917967 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:11.917667    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:11.917967 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:11.917781    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:13.481154 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.481116    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:13.481633 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.481281    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:13.481633 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.481358    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:29.481340562 +0000 UTC m=+34.125563429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:13.581884 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.581842    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:13.582084 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.582004    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:13.582146 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.582092    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:29.582071112 +0000 UTC m=+34.226293975 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:13.682500 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.682464    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:13.682651 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.682636    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:33:13.682712 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.682659    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:33:13.682712 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.682673    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:13.682815 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.682737    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:33:29.682721187 +0000 UTC m=+34.326944060 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:13.916779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.916710    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:13.916779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.916739    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:13.916953 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.916829    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:13.916953 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.916894    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:13.916953 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:13.916933    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:13.917077 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:13.917035    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:15.920429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:15.920400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:15.920429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:15.920419    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:15.920922 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:15.920504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:15.920922 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:15.920514    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:15.920922 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:15.920610    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:15.920922 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:15.920689    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:17.919147 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:17.919118    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:17.919685 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:17.919217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:17.919685 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:17.919241    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:17.919685 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:17.919231    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:17.919685 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:17.919338    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:17.919685 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:17.919411    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:19.029779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.029377    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rgxwx" event={"ID":"8d11b391-c98d-4cbb-a53a-d32cd4dc8c92","Type":"ContainerStarted","Data":"1ac1ec4bd5f3a58c21679a62c70c819bd1494ccae91c9dcd07bb342fd006cbae"}
Jul 16 17:33:19.032771 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.032748    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:33:19.033250 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033225    2577 generic.go:356] "Generic (PLEG): container finished" podID="a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c" containerID="f65ec4887b13fc2cce418a62fccd8008fff71c31b78334fbdb2e167078a04280" exitCode=1
Jul 16 17:33:19.033392 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"a914bc050ebbb90b3b08c52243c88fc147c488f6117d9fb4903ca5664fd8f5ff"}
Jul 16 17:33:19.033460 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"85ff86e956e9012afd44e4bad33465b450b255e3b9f827f88918af4e53b6b20b"}
Jul 16 17:33:19.033522 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"be02215e1622090e2695ec5609c8d607d98f750ee1e2b55e8bcd9d8673a40615"}
Jul 16 17:33:19.033576 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033565    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"cae14fbed710bd26ddf414080c62ab5b5906a9ac769520f8b3faf2dfa2c6d195"}
Jul 16 17:33:19.033630 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerDied","Data":"f65ec4887b13fc2cce418a62fccd8008fff71c31b78334fbdb2e167078a04280"}
Jul 16 17:33:19.033678 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.033665    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"c17da646d8f0479c4a35ecccecb4eb1a57724f58f4746265f75e0c6b565abc76"}
Jul 16 17:33:19.035446 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.035418    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-st246" event={"ID":"2a867c14-e6d3-4bce-ab09-4f2b30ccca41","Type":"ContainerStarted","Data":"e4eedd1825331ba1b3866dea7c46b85bcf5292d6c70328f1b73528b8ec2cf398"}
Jul 16 17:33:19.037045 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.037028    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-k6vc5" event={"ID":"13062e48-bf9d-49e5-880b-af8dd4584637","Type":"ContainerStarted","Data":"550bbce38c554e3e98d248236a3854c0d198fdd302cd9dcb827d4ae89125293f"}
Jul 16 17:33:19.038748 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.038726    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="59e6f2a649749c58c1e08b1de086e8db0bb285f677d1ee0e921a4aea17c6f094" exitCode=0
Jul 16 17:33:19.038851 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.038803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"59e6f2a649749c58c1e08b1de086e8db0bb285f677d1ee0e921a4aea17c6f094"}
Jul 16 17:33:19.040807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.040786    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gdnxt" event={"ID":"9b442b11-cb9c-4bac-87fa-8a7b1411f2bf","Type":"ContainerStarted","Data":"971ccc53b4ba68aeeddc174a8e6de3b5e0f5b91187cc8cd63ecdb043798bfec5"}
Jul 16 17:33:19.042452 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.042431    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hjxjg" event={"ID":"fff13d95-11f7-4a89-b299-3eef19f2f823","Type":"ContainerStarted","Data":"0fb729394e137f21ce06d32d6bae5605aec3349e7688035c5f1395170a78ffdb"}
Jul 16 17:33:19.044207 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.044184    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n" event={"ID":"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109","Type":"ContainerStarted","Data":"6b8e51bb121f32c9a02be4185f9759faa11b80c1f421c7c0f337fbb02e9a9573"}
Jul 16 17:33:19.055051 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.055015    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rgxwx" podStartSLOduration=4.004849351 podStartE2EDuration="23.055002789s" totalImagesPullingTime="19.050153438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:19.054792154 +0000 UTC m=+23.699015033" watchObservedRunningTime="2026-07-16 17:33:19.055002789 +0000 UTC m=+23.699225668"
Jul 16 17:33:19.055482 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.055445    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-76.ec2.internal" podStartSLOduration=22.055432526 podStartE2EDuration="22.055432526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:01.011644041 +0000 UTC m=+5.655866928" watchObservedRunningTime="2026-07-16 17:33:19.055432526 +0000 UTC m=+23.699655407"
Jul 16 17:33:19.110934 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.110882    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hjxjg" podStartSLOduration=4.02916985 podStartE2EDuration="23.110866229s" totalImagesPullingTime="19.081696379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:19.110745193 +0000 UTC m=+23.754968071" watchObservedRunningTime="2026-07-16 17:33:19.110866229 +0000 UTC m=+23.755089107"
Jul 16 17:33:19.138976 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.138928    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-st246" podStartSLOduration=4.101181184 podStartE2EDuration="23.13891277s" totalImagesPullingTime="19.037731586s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:19.13816235 +0000 UTC m=+23.782385240" watchObservedRunningTime="2026-07-16 17:33:19.13891277 +0000 UTC m=+23.783135652"
Jul 16 17:33:19.150343 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.150317    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:33:19.150846 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.150829    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:33:19.165279 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.165224    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gdnxt" podStartSLOduration=4.114405518 podStartE2EDuration="23.165212297s" totalImagesPullingTime="19.050806779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:19.165188438 +0000 UTC m=+23.809411317" watchObservedRunningTime="2026-07-16 17:33:19.165212297 +0000 UTC m=+23.809435176"
Jul 16 17:33:19.184363 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.184318    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-k6vc5" podStartSLOduration=4.145486673 podStartE2EDuration="23.184285514s" totalImagesPullingTime="19.038798841s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:19.184041472 +0000 UTC m=+23.828264332" watchObservedRunningTime="2026-07-16 17:33:19.184285514 +0000 UTC m=+23.828508393"
Jul 16 17:33:19.324628 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.324538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:19.447145 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.447037    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:19.518864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.518842    2577 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 16 17:33:19.813348 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.813163    2577 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T17:33:19.51886046Z","UUID":"f5de5830-dd2c-4c40-9576-a2867b22582b","Handler":null,"Name":"","Endpoint":""}
Jul 16 17:33:19.814812 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.814790    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 16 17:33:19.814934 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.814836    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 16 17:33:19.920516 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.920476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:19.920690 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.920476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:19.920690 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:19.920596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:19.920690 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:19.920483    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:19.920690 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:19.920672    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:19.920906 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:19.920726    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:20.049156 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.049120    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n" event={"ID":"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109","Type":"ContainerStarted","Data":"d8cf7ecee671324357fd816eedddbce7a79c9a5a85df48f43cf744eecf7c330b"}
Jul 16 17:33:20.050992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.050955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-twj5p" event={"ID":"2a33695a-6bc6-418a-a646-8f1b25211151","Type":"ContainerStarted","Data":"760f9d5fc0844b876dda36d31b3a1d6cc0865a7ef7a0dd3419e8d443217eb4cd"}
Jul 16 17:33:20.051385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.051303    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:33:20.051961 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.051943    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gdnxt"
Jul 16 17:33:20.081779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.081672    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-twj5p" podStartSLOduration=5.038138208 podStartE2EDuration="24.081651291s" totalImagesPullingTime="19.043513083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:20.081323417 +0000 UTC m=+24.725546293" watchObservedRunningTime="2026-07-16 17:33:20.081651291 +0000 UTC m=+24.725874171"
Jul 16 17:33:20.181750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.181718    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:20.279832 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.279784    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:20.380228 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:20.380146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:21.056415 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.056119    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n" event={"ID":"a9c7cfbc-d4cc-4dac-a0f6-03825ae26109","Type":"ContainerStarted","Data":"a1b391a826ff12aa8d2f45fa01038f824ef36614075db544731daa18b8720edc"}
Jul 16 17:33:21.061582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.061559    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:33:21.062001 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.061973    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"d720d2ecdb7d081d7cba58766c7d4292a4063e83679606348c9cbfc149be1be5"}
Jul 16 17:33:21.078010 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.077964    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zpr7n" podStartSLOduration=3.670931818 podStartE2EDuration="25.077950436s" totalImagesPullingTime="21.407018618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:21.077864163 +0000 UTC m=+25.722087044" watchObservedRunningTime="2026-07-16 17:33:21.077950436 +0000 UTC m=+25.722173315"
Jul 16 17:33:21.916511 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.916480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:21.916707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.916480    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:21.916707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:21.916602    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:21.916707 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:21.916595    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:21.916882 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:21.916714    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:21.916882 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:21.916805    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:23.162148 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:23.162124    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:23.916482 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:23.916327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:23.916625 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:23.916324    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:23.916675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:23.916348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:23.916675 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:23.916660    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:23.916755 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:23.916691    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:23.916755 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:23.916553    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:24.070890 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.070865    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:33:24.071227 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.071205    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"19406d15347834d14e4dbd37032478b9a31e400c6253484e02d57974bb92795d"}
Jul 16 17:33:24.071485 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.071465    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:24.071570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.071530    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:24.071673 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.071655    2577 scope.go:117] "RemoveContainer" containerID="f65ec4887b13fc2cce418a62fccd8008fff71c31b78334fbdb2e167078a04280"
Jul 16 17:33:24.073184 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.073159    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="c658428ad8e498fa2425d079bb5f50226e9d6b0c4f95839ad510b0e7d112a8ee" exitCode=0
Jul 16 17:33:24.073284 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.073203    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"c658428ad8e498fa2425d079bb5f50226e9d6b0c4f95839ad510b0e7d112a8ee"}
Jul 16 17:33:24.088076 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.088056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:24.088253 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:24.088185    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:25.079156 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.079118    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:33:25.079954 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.079623    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" event={"ID":"a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c","Type":"ContainerStarted","Data":"415c2d7a771fef90e13f9c160247319d24fb5c3b0497eff03e7674aa74144c16"}
Jul 16 17:33:25.079954 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.079833    2577 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 16 17:33:25.110480 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.110438    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d" podStartSLOduration=10.034106749 podStartE2EDuration="29.11042468s" totalImagesPullingTime="19.076317931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:25.109266432 +0000 UTC m=+29.753489310" watchObservedRunningTime="2026-07-16 17:33:25.11042468 +0000 UTC m=+29.754647558"
Jul 16 17:33:25.356915 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.356842    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:25.432315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.432273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7pt8"]
Jul 16 17:33:25.432403 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.432392    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:25.432492 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:25.432475    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:25.435268 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.435246    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zq475"]
Jul 16 17:33:25.435383 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.435367    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:25.435510 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:25.435469    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:25.435894 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.435873    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-csmrc"]
Jul 16 17:33:25.436029 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:25.436016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:25.436123 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:25.436107    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:26.086741 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.086552    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="3789aa258b2b85cd3c0136bd6a1fb11748da3f7465ee47037f32bd568637d4c8" exitCode=0
Jul 16 17:33:26.086741 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.086616    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"3789aa258b2b85cd3c0136bd6a1fb11748da3f7465ee47037f32bd568637d4c8"}
Jul 16 17:33:26.916389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.916359    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:26.916389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.916378    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:26.916389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.916379    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:26.916725 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:26.916458    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:26.916725 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:26.916533    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:26.916725 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:26.916596    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:26.929734 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:26.929711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:27.046620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:27.046595    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:27.203531 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:27.203501    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:27.305535 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:27.305506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:28.093160 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:28.093126    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="19d4e93b95083a7506961b4de4850f5086d1ff570486cb2a6ce2bdbd4d8de64f" exitCode=0
Jul 16 17:33:28.093365 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:28.093200    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"19d4e93b95083a7506961b4de4850f5086d1ff570486cb2a6ce2bdbd4d8de64f"}
Jul 16 17:33:28.916850 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:28.916809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:28.917517 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:28.916809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:28.917517 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:28.916939    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:28.917517 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:28.916809    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:28.917517 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:28.917018    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:28.917517 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:28.917080    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:29.493977 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:29.493937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:29.494170 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.494087    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:29.494170 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.494156    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:01.494136644 +0000 UTC m=+66.138359515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 16 17:33:29.595262 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:29.595222    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:29.595455 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.595403    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:29.595518 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.595485    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret podName:527be017-dd6d-4ba2-9799-353afac35e75 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:01.595465152 +0000 UTC m=+66.239688013 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret") pod "global-pull-secret-syncer-q7pt8" (UID: "527be017-dd6d-4ba2-9799-353afac35e75") : object "kube-system"/"original-pull-secret" not registered
Jul 16 17:33:29.696269 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:29.696224    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:29.696432 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.696409    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 16 17:33:29.696432 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.696431    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 16 17:33:29.696524 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.696443    2577 projected.go:196] Error preparing data for projected volume kube-api-access-f52c6 for pod openshift-network-diagnostics/network-check-target-csmrc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:29.696524 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:29.696507    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6 podName:051d3543-56e1-4d01-b5f3-ca9229c10895 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:01.696492587 +0000 UTC m=+66.340715444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f52c6" (UniqueName: "kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6") pod "network-check-target-csmrc" (UID: "051d3543-56e1-4d01-b5f3-ca9229c10895") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 16 17:33:30.916911 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:30.916877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:30.917418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:30.916877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:30.917418 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:30.917010    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zq475" podUID="a77096c1-aac2-46ec-8239-b2515f2b081a"
Jul 16 17:33:30.917418 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:30.917072    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-csmrc" podUID="051d3543-56e1-4d01-b5f3-ca9229c10895"
Jul 16 17:33:30.917418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:30.916877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:30.917418 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:30.917158    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q7pt8" podUID="527be017-dd6d-4ba2-9799-353afac35e75"
Jul 16 17:33:31.155678 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.155608    2577 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-76.ec2.internal" event="NodeReady"
Jul 16 17:33:31.155817 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.155759    2577 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 16 17:33:31.208644 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.208412    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-r6nfk"]
Jul 16 17:33:31.235076 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.235043    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dpphb"]
Jul 16 17:33:31.235218 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.235138    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.237721 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.237698    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 16 17:33:31.237859 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.237745    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7tn9x\""
Jul 16 17:33:31.237859 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.237791    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 16 17:33:31.250732 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.250661    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpphb"]
Jul 16 17:33:31.250844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.250737    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.250844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.250763    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6nfk"]
Jul 16 17:33:31.253507 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.253479    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 16 17:33:31.253507 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.253498    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 16 17:33:31.253718 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.253524    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 16 17:33:31.253884 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.253857    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4ccwt\""
Jul 16 17:33:31.307982 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.307954    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c618dbe-3d0a-4612-8731-8c851661de7a-tmp-dir\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.308156 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.308002    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcjkg\" (UniqueName: \"kubernetes.io/projected/8c618dbe-3d0a-4612-8731-8c851661de7a-kube-api-access-zcjkg\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.308156 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.308022    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.308156 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.308143    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c618dbe-3d0a-4612-8731-8c851661de7a-config-volume\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.380326 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.380274    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:31.409038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.408959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c618dbe-3d0a-4612-8731-8c851661de7a-config-volume\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.409038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409013    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c618dbe-3d0a-4612-8731-8c851661de7a-tmp-dir\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.409238 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs8xr\" (UniqueName: \"kubernetes.io/projected/faad28a0-472d-4679-bab9-efe43ed45208-kube-api-access-fs8xr\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.409238 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcjkg\" (UniqueName: \"kubernetes.io/projected/8c618dbe-3d0a-4612-8731-8c851661de7a-kube-api-access-zcjkg\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.409238 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.409430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faad28a0-472d-4679-bab9-efe43ed45208-cert\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.409470 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409441    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8c618dbe-3d0a-4612-8731-8c851661de7a-tmp-dir\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.409470 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:31.409458    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:31.409546 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:31.409511    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:31.909493035 +0000 UTC m=+36.553715907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:31.409698 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.409674    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8c618dbe-3d0a-4612-8731-8c851661de7a-config-volume\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.422923 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.422793    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcjkg\" (UniqueName: \"kubernetes.io/projected/8c618dbe-3d0a-4612-8731-8c851661de7a-kube-api-access-zcjkg\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.509929 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.509881    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faad28a0-472d-4679-bab9-efe43ed45208-cert\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.510125 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.510003    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs8xr\" (UniqueName: \"kubernetes.io/projected/faad28a0-472d-4679-bab9-efe43ed45208-kube-api-access-fs8xr\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.513362 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.513338    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/faad28a0-472d-4679-bab9-efe43ed45208-cert\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.522894 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.522864    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs8xr\" (UniqueName: \"kubernetes.io/projected/faad28a0-472d-4679-bab9-efe43ed45208-kube-api-access-fs8xr\") pod \"ingress-canary-dpphb\" (UID: \"faad28a0-472d-4679-bab9-efe43ed45208\") " pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.559698 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.559665    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dpphb"
Jul 16 17:33:31.914468 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:31.914426    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:31.914653 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:31.914601    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:31.914717 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:31.914687    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:32.914669199 +0000 UTC m=+37.558892056 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:32.218997 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.218966    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dpphb"]
Jul 16 17:33:32.286721 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:33:32.286681    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaad28a0_472d_4679_bab9_efe43ed45208.slice/crio-1ee475eb23058f10370ab7594a8241252ae3fe38b2d6c8d54e2bea460714c04b WatchSource:0}: Error finding container 1ee475eb23058f10370ab7594a8241252ae3fe38b2d6c8d54e2bea460714c04b: Status 404 returned error can't find the container with id 1ee475eb23058f10370ab7594a8241252ae3fe38b2d6c8d54e2bea460714c04b
Jul 16 17:33:32.916707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.916619    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:33:32.916707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.916663    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:33:32.916707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.916622    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:33:32.920753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.920732    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:33:32.920753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.920733    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck2g5\""
Jul 16 17:33:32.921252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.921124    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:33:32.921252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.921135    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:33:32.921252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.921153    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:33:32.921252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.921167    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-455gg\""
Jul 16 17:33:32.923253 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:32.923049    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:32.923253 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:32.923206    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:32.923448 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:32.923325    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:34.923303264 +0000 UTC m=+39.567526136 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:33.106503 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:33.106469    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="4f4355dba07817430adb85d7d8c86b5d047fedd04c8c437555f692b652099881" exitCode=0
Jul 16 17:33:33.106654 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:33.106554    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"4f4355dba07817430adb85d7d8c86b5d047fedd04c8c437555f692b652099881"}
Jul 16 17:33:33.107933 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:33.107630    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpphb" event={"ID":"faad28a0-472d-4679-bab9-efe43ed45208","Type":"ContainerStarted","Data":"1ee475eb23058f10370ab7594a8241252ae3fe38b2d6c8d54e2bea460714c04b"}
Jul 16 17:33:34.113902 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:34.113675    2577 generic.go:356] "Generic (PLEG): container finished" podID="46e61a52-2b88-4c58-9d32-70b6e32e35da" containerID="daf0c2e959736346fb175815f4b125bf271b67a51f9588694b3a0f3f1ea8de89" exitCode=0
Jul 16 17:33:34.114349 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:34.113737    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerDied","Data":"daf0c2e959736346fb175815f4b125bf271b67a51f9588694b3a0f3f1ea8de89"}
Jul 16 17:33:34.941757 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:34.941733    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:34.941903 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:34.941882    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:34.941967 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:34.941957    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:38.941935875 +0000 UTC m=+43.586158735 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:35.117783 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:35.117748    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dpphb" event={"ID":"faad28a0-472d-4679-bab9-efe43ed45208","Type":"ContainerStarted","Data":"fd3c237a20cd1e2e77ef8e332270e1e7fb510d0105700f142a949b7d28397808"}
Jul 16 17:33:35.120885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:35.120856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" event={"ID":"46e61a52-2b88-4c58-9d32-70b6e32e35da","Type":"ContainerStarted","Data":"7e67722b84d92ab192742fb91ad654fc9488c98840a5559f02ea4c5da61225ac"}
Jul 16 17:33:35.136150 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:35.136087    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dpphb" podStartSLOduration=1.5150385229999999 podStartE2EDuration="4.136068471s" totalImagesPullingTime="2.621029948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:35.13574838 +0000 UTC m=+39.779971261" watchObservedRunningTime="2026-07-16 17:33:35.136068471 +0000 UTC m=+39.780291350"
Jul 16 17:33:35.161344 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:35.161275    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5k8wp" podStartSLOduration=9.270254566 podStartE2EDuration="39.161255987s" totalImagesPullingTime="29.891001421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:33:35.159988398 +0000 UTC m=+39.804211276" watchObservedRunningTime="2026-07-16 17:33:35.161255987 +0000 UTC m=+39.805478868"
Jul 16 17:33:35.406637 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:35.406557    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:38.967668 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:38.967625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:38.968191 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:38.967775    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:38.968191 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:38.967842    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:33:46.967826479 +0000 UTC m=+51.612049335 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:40.814994 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:40.814959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:47.020992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:47.020959    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:33:47.021461 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:47.021091    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:33:47.021461 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:33:47.021146    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:03.021130581 +0000 UTC m=+67.665353439 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:33:49.927777 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:49.927745    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:49.997132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:49.997104    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:50.380169 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:50.380137    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:57.099185 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:57.099152    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8bk6d"
Jul 16 17:33:57.301432 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:57.301397    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:33:57.582743 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:33:57.582713    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:01.522510 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.522459    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:34:01.525612 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.525596    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 16 17:34:01.532870 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:01.532851    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 16 17:34:01.535410 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:01.533655    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs podName:a77096c1-aac2-46ec-8239-b2515f2b081a nodeName:}" failed. No retries permitted until 2026-07-16 17:35:05.533626409 +0000 UTC m=+130.177849266 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs") pod "network-metrics-daemon-zq475" (UID: "a77096c1-aac2-46ec-8239-b2515f2b081a") : secret "metrics-daemon-secret" not found
Jul 16 17:34:01.623680 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.623636    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:34:01.626673 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.626653    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 16 17:34:01.638228 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.638195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/527be017-dd6d-4ba2-9799-353afac35e75-original-pull-secret\") pod \"global-pull-secret-syncer-q7pt8\" (UID: \"527be017-dd6d-4ba2-9799-353afac35e75\") " pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:34:01.724821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.724777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:34:01.727856 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.727839    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 16 17:34:01.737903 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.737887    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 16 17:34:01.741247 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.741231    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q7pt8"
Jul 16 17:34:01.748492 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.748470    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52c6\" (UniqueName: \"kubernetes.io/projected/051d3543-56e1-4d01-b5f3-ca9229c10895-kube-api-access-f52c6\") pod \"network-check-target-csmrc\" (UID: \"051d3543-56e1-4d01-b5f3-ca9229c10895\") " pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:34:01.866232 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:01.866196    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q7pt8"]
Jul 16 17:34:02.031750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:02.031720    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ck2g5\""
Jul 16 17:34:02.039327 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:02.039246    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:34:02.172508 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:02.172434    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-csmrc"]
Jul 16 17:34:02.175899 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:02.175874    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod051d3543_56e1_4d01_b5f3_ca9229c10895.slice/crio-271f58202457b5afc43d8a9e1ce252249b8a008f2c5a5cb73dd4405ced906685 WatchSource:0}: Error finding container 271f58202457b5afc43d8a9e1ce252249b8a008f2c5a5cb73dd4405ced906685: Status 404 returned error can't find the container with id 271f58202457b5afc43d8a9e1ce252249b8a008f2c5a5cb73dd4405ced906685
Jul 16 17:34:02.184427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:02.184400    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-csmrc" event={"ID":"051d3543-56e1-4d01-b5f3-ca9229c10895","Type":"ContainerStarted","Data":"271f58202457b5afc43d8a9e1ce252249b8a008f2c5a5cb73dd4405ced906685"}
Jul 16 17:34:02.185464 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:02.185438    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7pt8" event={"ID":"527be017-dd6d-4ba2-9799-353afac35e75","Type":"ContainerStarted","Data":"dcec2b3c70db8e3df8964cd39269a168d78fe8a55871a10363a6e1d5848c275e"}
Jul 16 17:34:03.035313 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:03.035234    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:03.035861 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:03.035422    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 16 17:34:03.035861 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:03.035502    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls podName:8c618dbe-3d0a-4612-8731-8c851661de7a nodeName:}" failed. No retries permitted until 2026-07-16 17:34:35.035479972 +0000 UTC m=+99.679702844 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls") pod "dns-default-r6nfk" (UID: "8c618dbe-3d0a-4612-8731-8c851661de7a") : secret "dns-default-metrics-tls" not found
Jul 16 17:34:07.201929 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:07.201890    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-csmrc" event={"ID":"051d3543-56e1-4d01-b5f3-ca9229c10895","Type":"ContainerStarted","Data":"d7e04cba060d6b70b59b65a63afc81a304c59452d75e5a4cf1b33a0cde0dbbfc"}
Jul 16 17:34:07.202413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:07.201983    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:34:07.203285 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:07.203262    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q7pt8" event={"ID":"527be017-dd6d-4ba2-9799-353afac35e75","Type":"ContainerStarted","Data":"2cb87545c821cfaadf30471e0320e20d273981384b86000ac8a95007d59d3672"}
Jul 16 17:34:07.223105 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:07.223060    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-csmrc" podStartSLOduration=66.614576835 podStartE2EDuration="1m11.223043705s" totalImagesPullingTime="4.60846687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:07.222974482 +0000 UTC m=+71.867197361" watchObservedRunningTime="2026-07-16 17:34:07.223043705 +0000 UTC m=+71.867266583"
Jul 16 17:34:07.247707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:07.247658    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q7pt8" podStartSLOduration=66.328641061 podStartE2EDuration="1m11.247641517s" totalImagesPullingTime="4.919000456s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:07.247431453 +0000 UTC m=+71.891654332" watchObservedRunningTime="2026-07-16 17:34:07.247641517 +0000 UTC m=+71.891864396"
Jul 16 17:34:13.306369 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.306335    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-4hw7p"]
Jul 16 17:34:13.308571 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.308557    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.315320 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.315284    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 16 17:34:13.315419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.315330    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 16 17:34:13.316683 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.316664    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:34:13.316779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.316700    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 16 17:34:13.316779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.316734    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-ztpv9\""
Jul 16 17:34:13.320175 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.320158    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 16 17:34:13.326192 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.326171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4hw7p"]
Jul 16 17:34:13.405056 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.405023    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-trusted-ca\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.405234 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.405061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hhlm\" (UniqueName: \"kubernetes.io/projected/7a577200-d34d-4a27-8e79-a4061138271e-kube-api-access-9hhlm\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.405234 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.405150    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-config\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.405234 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.405185    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a577200-d34d-4a27-8e79-a4061138271e-serving-cert\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.465448 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.465414    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"]
Jul 16 17:34:13.467304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.467270    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"]
Jul 16 17:34:13.467411 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.467393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.468930 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.468913    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rwj5c"]
Jul 16 17:34:13.469036 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.469022    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.470604 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.470587    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.471877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.471852    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 16 17:34:13.471877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.471859    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 16 17:34:13.471877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.471859    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:34:13.472093 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.471963    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-8cv4f\""
Jul 16 17:34:13.472159 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.472096    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 16 17:34:13.473789 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.473774    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 16 17:34:13.474463 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.474441    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 16 17:34:13.474946 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.474930    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 16 17:34:13.475137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.475109    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 16 17:34:13.476514 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.476497    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 16 17:34:13.476607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.476533    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 16 17:34:13.476607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.476533    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 16 17:34:13.478241 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.478205    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7mmk9\""
Jul 16 17:34:13.478531 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.478516    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 16 17:34:13.478963 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.478947    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-nwwxt\""
Jul 16 17:34:13.495544 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.495524    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 16 17:34:13.500770 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.500750    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"]
Jul 16 17:34:13.501467 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.501448    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"]
Jul 16 17:34:13.506235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506217    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-trusted-ca\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.506303 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506243    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hhlm\" (UniqueName: \"kubernetes.io/projected/7a577200-d34d-4a27-8e79-a4061138271e-kube-api-access-9hhlm\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.506303 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506273    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfd9de6-540a-4e23-93e9-4678db64f636-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.506369 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506312    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.506369 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506341    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxxrj\" (UniqueName: \"kubernetes.io/projected/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-kube-api-access-bxxrj\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.506429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506371    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.506429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506402    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.506429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506424    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-tmp\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.506523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506446    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxvvm\" (UniqueName: \"kubernetes.io/projected/852c877c-5597-4f51-9540-13ea2ea6f28c-kube-api-access-mxvvm\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.506523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506468    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-snapshots\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.506590 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506532    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-config\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.506590 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a577200-d34d-4a27-8e79-a4061138271e-serving-cert\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.506590 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506584    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cfd9de6-540a-4e23-93e9-4678db64f636-config\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.506754 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506607    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.506754 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8vmg\" (UniqueName: \"kubernetes.io/projected/3cfd9de6-540a-4e23-93e9-4678db64f636-kube-api-access-p8vmg\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.506754 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.506662    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/852c877c-5597-4f51-9540-13ea2ea6f28c-serving-cert\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.507044 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.507027    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-trusted-ca\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.507100 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.507044    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7a577200-d34d-4a27-8e79-a4061138271e-config\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.508764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.508746    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7a577200-d34d-4a27-8e79-a4061138271e-serving-cert\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.520573 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.520549    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rwj5c"]
Jul 16 17:34:13.561117 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.561056    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hhlm\" (UniqueName: \"kubernetes.io/projected/7a577200-d34d-4a27-8e79-a4061138271e-kube-api-access-9hhlm\") pod \"console-operator-7866497494-4hw7p\" (UID: \"7a577200-d34d-4a27-8e79-a4061138271e\") " pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.607611 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.607611 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607617    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-tmp\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607634    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxvvm\" (UniqueName: \"kubernetes.io/projected/852c877c-5597-4f51-9540-13ea2ea6f28c-kube-api-access-mxvvm\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607664    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-snapshots\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cfd9de6-540a-4e23-93e9-4678db64f636-config\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607724    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:13.607742    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607754    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8vmg\" (UniqueName: \"kubernetes.io/projected/3cfd9de6-540a-4e23-93e9-4678db64f636-kube-api-access-p8vmg\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607776    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/852c877c-5597-4f51-9540-13ea2ea6f28c-serving-cert\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.607847 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:13.607837    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:14.107813255 +0000 UTC m=+78.752036134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:13.608315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607908    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfd9de6-540a-4e23-93e9-4678db64f636-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.608315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607935    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.608315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607957    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxxrj\" (UniqueName: \"kubernetes.io/projected/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-kube-api-access-bxxrj\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.608315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.607979    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.608315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.608075    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-tmp\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.608585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.608328    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/852c877c-5597-4f51-9540-13ea2ea6f28c-snapshots\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.608585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.608402    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3cfd9de6-540a-4e23-93e9-4678db64f636-config\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.608844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.608819    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.609069 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.609052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/852c877c-5597-4f51-9540-13ea2ea6f28c-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.609111 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.609059    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.610391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.610371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3cfd9de6-540a-4e23-93e9-4678db64f636-serving-cert\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.610391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.610383    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/852c877c-5597-4f51-9540-13ea2ea6f28c-serving-cert\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.617129 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.617106    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:13.627841 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.627820    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxvvm\" (UniqueName: \"kubernetes.io/projected/852c877c-5597-4f51-9540-13ea2ea6f28c-kube-api-access-mxvvm\") pod \"insights-operator-68d9dd94cf-rwj5c\" (UID: \"852c877c-5597-4f51-9540-13ea2ea6f28c\") " pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.627957 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.627931    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxxrj\" (UniqueName: \"kubernetes.io/projected/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-kube-api-access-bxxrj\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:13.629165 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.629142    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8vmg\" (UniqueName: \"kubernetes.io/projected/3cfd9de6-540a-4e23-93e9-4678db64f636-kube-api-access-p8vmg\") pod \"service-ca-operator-7695fc6c8c-g5vd2\" (UID: \"3cfd9de6-540a-4e23-93e9-4678db64f636\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.752006 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.751982    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-4hw7p"]
Jul 16 17:34:13.754493 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:13.754468    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a577200_d34d_4a27_8e79_a4061138271e.slice/crio-293c63a0cb9c35e98de0b8717c7e5d49e2c7539ecb7f184c006b673e44f06049 WatchSource:0}: Error finding container 293c63a0cb9c35e98de0b8717c7e5d49e2c7539ecb7f184c006b673e44f06049: Status 404 returned error can't find the container with id 293c63a0cb9c35e98de0b8717c7e5d49e2c7539ecb7f184c006b673e44f06049
Jul 16 17:34:13.777613 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.777589    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"
Jul 16 17:34:13.788308 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.788271    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c"
Jul 16 17:34:13.913911 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.913879    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:13.939220 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.939192    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2"]
Jul 16 17:34:13.942966 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:13.942943    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cfd9de6_540a_4e23_93e9_4678db64f636.slice/crio-466d525774fd712acda2ebe796d63a64c29aadcdaa15db44bf55a606d9fe4b38 WatchSource:0}: Error finding container 466d525774fd712acda2ebe796d63a64c29aadcdaa15db44bf55a606d9fe4b38: Status 404 returned error can't find the container with id 466d525774fd712acda2ebe796d63a64c29aadcdaa15db44bf55a606d9fe4b38
Jul 16 17:34:13.949557 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:13.949444    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-rwj5c"]
Jul 16 17:34:13.951608 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:13.951589    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852c877c_5597_4f51_9540_13ea2ea6f28c.slice/crio-d9f7ea397f4c676f584213e7dcbcae33e064b02766ab64a46559d5ee24032f46 WatchSource:0}: Error finding container d9f7ea397f4c676f584213e7dcbcae33e064b02766ab64a46559d5ee24032f46: Status 404 returned error can't find the container with id d9f7ea397f4c676f584213e7dcbcae33e064b02766ab64a46559d5ee24032f46
Jul 16 17:34:14.016400 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:14.016365    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:14.111270 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:14.111193    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:14.111422 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:14.111344    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:14.111422 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:14.111406    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:15.111386811 +0000 UTC m=+79.755609671 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:14.230196 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:14.230167    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2" event={"ID":"3cfd9de6-540a-4e23-93e9-4678db64f636","Type":"ContainerStarted","Data":"466d525774fd712acda2ebe796d63a64c29aadcdaa15db44bf55a606d9fe4b38"}
Jul 16 17:34:14.231154 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:14.231132    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4hw7p" event={"ID":"7a577200-d34d-4a27-8e79-a4061138271e","Type":"ContainerStarted","Data":"293c63a0cb9c35e98de0b8717c7e5d49e2c7539ecb7f184c006b673e44f06049"}
Jul 16 17:34:14.231992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:14.231970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c" event={"ID":"852c877c-5597-4f51-9540-13ea2ea6f28c","Type":"ContainerStarted","Data":"d9f7ea397f4c676f584213e7dcbcae33e064b02766ab64a46559d5ee24032f46"}
Jul 16 17:34:15.012216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:15.012177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:15.120484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:15.120451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:15.120657 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:15.120593    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:15.120657 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:15.120649    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:17.120634997 +0000 UTC m=+81.764857853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:15.125441 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:15.125410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:17.136012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.135904    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:17.136415 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:17.136032    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:17.136415 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:17.136097    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:21.136079318 +0000 UTC m=+85.780302181 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:17.242776 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.242743    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c" event={"ID":"852c877c-5597-4f51-9540-13ea2ea6f28c","Type":"ContainerStarted","Data":"608e529f2d2f29cda018c32dfa98ad94b2e2b93a98015689462ee95ba1a6de05"}
Jul 16 17:34:17.244374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.244341    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2" event={"ID":"3cfd9de6-540a-4e23-93e9-4678db64f636","Type":"ContainerStarted","Data":"60d8c848e440550cb25322595a378150958a840160bf06d3e71f2b0d4ad1a2e9"}
Jul 16 17:34:17.245906 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.245886    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/0.log"
Jul 16 17:34:17.246030 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.245918    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a577200-d34d-4a27-8e79-a4061138271e" containerID="2e6bded97d99842bdbcfc672ea13d1ddb59a0f87cbc4b0615edd2e913f660661" exitCode=255
Jul 16 17:34:17.246030 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.245946    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4hw7p" event={"ID":"7a577200-d34d-4a27-8e79-a4061138271e","Type":"ContainerDied","Data":"2e6bded97d99842bdbcfc672ea13d1ddb59a0f87cbc4b0615edd2e913f660661"}
Jul 16 17:34:17.246201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.246186    2577 scope.go:117] "RemoveContainer" containerID="2e6bded97d99842bdbcfc672ea13d1ddb59a0f87cbc4b0615edd2e913f660661"
Jul 16 17:34:17.265037 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.264986    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c" podStartSLOduration=1.4146902479999999 podStartE2EDuration="4.264969582s" totalImagesPullingTime="2.850279334s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:17.263841843 +0000 UTC m=+81.908064723" watchObservedRunningTime="2026-07-16 17:34:17.264969582 +0000 UTC m=+81.909192465"
Jul 16 17:34:17.345093 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:17.345026    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2" podStartSLOduration=1.478913103 podStartE2EDuration="4.345005431s" totalImagesPullingTime="2.866092328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:17.34425864 +0000 UTC m=+81.988481523" watchObservedRunningTime="2026-07-16 17:34:17.345005431 +0000 UTC m=+81.989228311"
Jul 16 17:34:18.250508 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.250482    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:34:18.250978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.250960    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/0.log"
Jul 16 17:34:18.251073 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.251001    2577 generic.go:356] "Generic (PLEG): container finished" podID="7a577200-d34d-4a27-8e79-a4061138271e" containerID="b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b" exitCode=255
Jul 16 17:34:18.251136 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.251096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4hw7p" event={"ID":"7a577200-d34d-4a27-8e79-a4061138271e","Type":"ContainerDied","Data":"b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b"}
Jul 16 17:34:18.251180 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.251155    2577 scope.go:117] "RemoveContainer" containerID="2e6bded97d99842bdbcfc672ea13d1ddb59a0f87cbc4b0615edd2e913f660661"
Jul 16 17:34:18.251483 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.251281    2577 scope.go:117] "RemoveContainer" containerID="b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b"
Jul 16 17:34:18.251589 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:18.251489    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4hw7p_openshift-console-operator(7a577200-d34d-4a27-8e79-a4061138271e)\"" pod="openshift-console-operator/console-operator-7866497494-4hw7p" podUID="7a577200-d34d-4a27-8e79-a4061138271e"
Jul 16 17:34:18.405886 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.405848    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:18.447877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.447848    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"]
Jul 16 17:34:18.452022 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.452003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"
Jul 16 17:34:18.455700 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.455678    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 16 17:34:18.456325 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.456309    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 16 17:34:18.456325 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.456319    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pbc56\""
Jul 16 17:34:18.468761 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.468738    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"]
Jul 16 17:34:18.547151 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.547074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrxr8\" (UniqueName: \"kubernetes.io/projected/72458b83-ad9f-48be-8fd8-aa779e92e718-kube-api-access-mrxr8\") pod \"migrator-7f59b54f6c-t6drc\" (UID: \"72458b83-ad9f-48be-8fd8-aa779e92e718\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"
Jul 16 17:34:18.582789 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.582728    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:18.628402 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.628373    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6hc7d"]
Jul 16 17:34:18.631604 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.631582    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.634505 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.634482    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 16 17:34:18.634601 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.634482    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 16 17:34:18.635167 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.635132    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vxz8n\""
Jul 16 17:34:18.645848 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.645815    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hc7d"]
Jul 16 17:34:18.648281 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648256    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e843a222-8ac1-471a-99a1-a690742e8b6b-crio-socket\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.648449 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e843a222-8ac1-471a-99a1-a690742e8b6b-data-volume\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.648601 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648580    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrxr8\" (UniqueName: \"kubernetes.io/projected/72458b83-ad9f-48be-8fd8-aa779e92e718-kube-api-access-mrxr8\") pod \"migrator-7f59b54f6c-t6drc\" (UID: \"72458b83-ad9f-48be-8fd8-aa779e92e718\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"
Jul 16 17:34:18.648668 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648617    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf847\" (UniqueName: \"kubernetes.io/projected/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-api-access-hf847\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.648668 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648650    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.648774 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.648704    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.664197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.664169    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrxr8\" (UniqueName: \"kubernetes.io/projected/72458b83-ad9f-48be-8fd8-aa779e92e718-kube-api-access-mrxr8\") pod \"migrator-7f59b54f6c-t6drc\" (UID: \"72458b83-ad9f-48be-8fd8-aa779e92e718\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"
Jul 16 17:34:18.707835 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.707806    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:18.749240 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749213    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf847\" (UniqueName: \"kubernetes.io/projected/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-api-access-hf847\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749251    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749321    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749361    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e843a222-8ac1-471a-99a1-a690742e8b6b-crio-socket\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749383    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e843a222-8ac1-471a-99a1-a690742e8b6b-data-volume\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749499    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e843a222-8ac1-471a-99a1-a690742e8b6b-crio-socket\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.749607 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:18.749555    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:34:18.749709 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:18.749631    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:19.249608918 +0000 UTC m=+83.893831801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : configmap "kube-rbac-proxy" not found
Jul 16 17:34:18.749709 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:18.749664    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:18.749803 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:18.749714    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:19.249699545 +0000 UTC m=+83.893922402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:18.749803 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.749712    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e843a222-8ac1-471a-99a1-a690742e8b6b-data-volume\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.760654 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.760630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"
Jul 16 17:34:18.761509 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.761487    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf847\" (UniqueName: \"kubernetes.io/projected/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-api-access-hf847\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:18.875872 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.875838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:18.886435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:18.886413    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc"]
Jul 16 17:34:18.889880 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:18.889858    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72458b83_ad9f_48be_8fd8_aa779e92e718.slice/crio-9f24a93631ae6f65f1bca9103bab7fa68f2ad74aa97df2272df6818b3b6e3b37 WatchSource:0}: Error finding container 9f24a93631ae6f65f1bca9103bab7fa68f2ad74aa97df2272df6818b3b6e3b37: Status 404 returned error can't find the container with id 9f24a93631ae6f65f1bca9103bab7fa68f2ad74aa97df2272df6818b3b6e3b37
Jul 16 17:34:19.035500 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.035469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:19.253442 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.253406    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:19.253810 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.253474    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:19.253810 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:19.253548    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:19.253810 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:19.253587    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:34:19.253810 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:19.253610    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:20.253594664 +0000 UTC m=+84.897817520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:19.253810 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:19.253633    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:20.253620034 +0000 UTC m=+84.897842891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : configmap "kube-rbac-proxy" not found
Jul 16 17:34:19.255585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.255570    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:34:19.255943 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.255921    2577 scope.go:117] "RemoveContainer" containerID="b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b"
Jul 16 17:34:19.256075 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:19.256055    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4hw7p_openshift-console-operator(7a577200-d34d-4a27-8e79-a4061138271e)\"" pod="openshift-console-operator/console-operator-7866497494-4hw7p" podUID="7a577200-d34d-4a27-8e79-a4061138271e"
Jul 16 17:34:19.256862 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.256843    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc" event={"ID":"72458b83-ad9f-48be-8fd8-aa779e92e718","Type":"ContainerStarted","Data":"9f24a93631ae6f65f1bca9103bab7fa68f2ad74aa97df2272df6818b3b6e3b37"}
Jul 16 17:34:19.264745 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.264715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:19.373104 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.373073    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:19.509599 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.509512    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:19.612199 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:19.612167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:20.261057 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:20.261030    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:20.261457 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:20.261071    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:20.261457 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:20.261163    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:34:20.261457 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:20.261179    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:20.261457 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:20.261211    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.261198547 +0000 UTC m=+86.905421404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : configmap "kube-rbac-proxy" not found
Jul 16 17:34:20.261457 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:20.261223    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:22.261217216 +0000 UTC m=+86.905440072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:21.169706 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.169677    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:21.169865 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:21.169814    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:21.169865 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:21.169864    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:29.169850271 +0000 UTC m=+93.814073132 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:21.199341 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.199313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:21.266069 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.266037    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc" event={"ID":"72458b83-ad9f-48be-8fd8-aa779e92e718","Type":"ContainerStarted","Data":"f742def023fae2289e1d539b786c5300a8221be600c7f8222d95edc8c106ae96"}
Jul 16 17:34:21.266522 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.266096    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc" event={"ID":"72458b83-ad9f-48be-8fd8-aa779e92e718","Type":"ContainerStarted","Data":"03397d406e82e2cab6801715c2dd72a60b8714ff61be8b95413fdf51e86314bf"}
Jul 16 17:34:21.288053 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.287926    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-t6drc" podStartSLOduration=1.115451375 podStartE2EDuration="3.287910103s" totalImagesPullingTime="2.172458728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:21.287257506 +0000 UTC m=+85.931480384" watchObservedRunningTime="2026-07-16 17:34:21.287910103 +0000 UTC m=+85.932132983"
Jul 16 17:34:21.627068 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.627042    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rgxwx_8d11b391-c98d-4cbb-a53a-d32cd4dc8c92/dns-node-resolver/0.log"
Jul 16 17:34:21.866714 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:21.866684    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:22.225757 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:22.225733    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6vc5_13062e48-bf9d-49e5-880b-af8dd4584637/node-ca/0.log"
Jul 16 17:34:22.278708 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:22.278684    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:22.279041 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:22.278727    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:22.279041 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:22.278794    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:34:22.279041 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:22.278822    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:22.279041 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:22.278843    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:26.278825124 +0000 UTC m=+90.923047980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : configmap "kube-rbac-proxy" not found
Jul 16 17:34:22.279041 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:22.278867    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:26.278855031 +0000 UTC m=+90.923077888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:23.223740 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.223712    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpphb_faad28a0-472d-4679-bab9-efe43ed45208/serve-healthcheck-canary/0.log"
Jul 16 17:34:23.618105 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.618083    2577 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:23.618470 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.618163    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:23.618510 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.618475    2577 scope.go:117] "RemoveContainer" containerID="b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b"
Jul 16 17:34:23.618632 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:23.618614    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-4hw7p_openshift-console-operator(7a577200-d34d-4a27-8e79-a4061138271e)\"" pod="openshift-console-operator/console-operator-7866497494-4hw7p" podUID="7a577200-d34d-4a27-8e79-a4061138271e"
Jul 16 17:34:23.627058 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.627029    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-t6drc_72458b83-ad9f-48be-8fd8-aa779e92e718/migrator/0.log"
Jul 16 17:34:23.637431 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.637404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:23.823742 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:23.823711    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-t6drc_72458b83-ad9f-48be-8fd8-aa779e92e718/graceful-termination/0.log"
Jul 16 17:34:24.132418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:24.132381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:25.660986 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:25.660957    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:25.861821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:25.861788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:25.979607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:25.979542    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:26.307677 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:26.307580    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:26.311485 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:26.311465    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:26.311569 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:26.311554    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:26.311646 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:26.311579    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 16 17:34:26.311646 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:26.311635    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:34.311617948 +0000 UTC m=+98.955840820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : configmap "kube-rbac-proxy" not found
Jul 16 17:34:26.311717 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:26.311668    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:26.311717 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:26.311711    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:34.311698692 +0000 UTC m=+98.955921549 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:26.721944 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:26.721912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:27.490491 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:27.490458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:27.959554 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:27.959515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:28.029646 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:28.029617    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:28.099479 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:28.099441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:28.302050 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:28.301971    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:28.911649 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:28.911608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:29.237831 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:29.237737    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:29.238230 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:29.237911    2577 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:29.238230 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:29.237978    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls podName:1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6 nodeName:}" failed. No retries permitted until 2026-07-16 17:34:45.237962311 +0000 UTC m=+109.882185168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-ddcpz" (UID: "1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6") : secret "cluster-monitoring-operator-tls" not found
Jul 16 17:34:29.307368 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:29.307342    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:29.407570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:29.407540    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:29.702639 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:29.702606    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:29.900987 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:29.900955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:30.553197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:30.553167    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:30.623576 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:30.623544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:31.343982 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:31.343955    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:31.561095 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:31.561063    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:31.622235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:31.622204    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:31.687055 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:31.687029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:31.883865 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:31.883778    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:32.089737 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:32.089701    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:32.293062 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:32.292966    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:33.297829 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:33.297790    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:33.629888 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:33.629855    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:33.730306 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:33.730229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:33.889666 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:33.889575    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:34.100461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:34.100429    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:34.294764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:34.294683    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:34.374062 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:34.374031    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:34.374477 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:34.374086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:34.374477 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:34.374194    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:34.374477 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:34:34.374268    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls podName:e843a222-8ac1-471a-99a1-a690742e8b6b nodeName:}" failed. No retries permitted until 2026-07-16 17:34:50.374253316 +0000 UTC m=+115.018476173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6hc7d" (UID: "e843a222-8ac1-471a-99a1-a690742e8b6b") : secret "insights-runtime-extractor-tls" not found
Jul 16 17:34:34.374632 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:34.374617    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e843a222-8ac1-471a-99a1-a690742e8b6b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:35.079996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.079916    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:35.082136 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.082105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8c618dbe-3d0a-4612-8731-8c851661de7a-metrics-tls\") pod \"dns-default-r6nfk\" (UID: \"8c618dbe-3d0a-4612-8731-8c851661de7a\") " pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:35.103020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.102993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:35.148581 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.148558    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7tn9x\""
Jul 16 17:34:35.155987 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.155971    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:35.209157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.209101    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:35.281689 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.281669    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-r6nfk"]
Jul 16 17:34:35.283844 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:35.283811    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c618dbe_3d0a_4612_8731_8c851661de7a.slice/crio-cef8b9884b81594ad3e268dd3eb4eeed030fb64b5567d2cbcdd884a5b13f1bb6 WatchSource:0}: Error finding container cef8b9884b81594ad3e268dd3eb4eeed030fb64b5567d2cbcdd884a5b13f1bb6: Status 404 returned error can't find the container with id cef8b9884b81594ad3e268dd3eb4eeed030fb64b5567d2cbcdd884a5b13f1bb6
Jul 16 17:34:35.309548 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:35.309518    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6nfk" event={"ID":"8c618dbe-3d0a-4612-8731-8c851661de7a","Type":"ContainerStarted","Data":"cef8b9884b81594ad3e268dd3eb4eeed030fb64b5567d2cbcdd884a5b13f1bb6"}
Jul 16 17:34:36.778805 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:36.778768    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:36.847432 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:36.847393    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:36.917405 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:36.917367    2577 scope.go:117] "RemoveContainer" containerID="b983c52e8286ebc540ce0f64976f54cff6eb4d026a7001502033bb4a7ce3852b"
Jul 16 17:34:37.317132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.317062    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:34:37.317262 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.317141    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-4hw7p" event={"ID":"7a577200-d34d-4a27-8e79-a4061138271e","Type":"ContainerStarted","Data":"25549b65308877001cce1f189e25dd48a00d42c0a0802f4dfae1561ee923b9a5"}
Jul 16 17:34:37.317430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.317413    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:37.337780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.337728    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-4hw7p" podStartSLOduration=21.288256641 podStartE2EDuration="24.337710659s" totalImagesPullingTime="3.049454018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:37.336553932 +0000 UTC m=+101.980776822" watchObservedRunningTime="2026-07-16 17:34:37.337710659 +0000 UTC m=+101.981933538"
Jul 16 17:34:37.566871 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.566812    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-4hw7p"
Jul 16 17:34:37.751668 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.751620    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:37.867015 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:37.866983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:38.061181 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.061150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:38.207983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.207915    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-csmrc"
Jul 16 17:34:38.246073 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.246039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:38.321830 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.321799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6nfk" event={"ID":"8c618dbe-3d0a-4612-8731-8c851661de7a","Type":"ContainerStarted","Data":"d5c1622e8085bb8234e0a28417357cfe4877209e1f86ffe3c46eaad65c402a4e"}
Jul 16 17:34:38.321966 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.321847    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-r6nfk" event={"ID":"8c618dbe-3d0a-4612-8731-8c851661de7a","Type":"ContainerStarted","Data":"586cde28b4fac295b28aa3140b815be09eaac2b2d1684bfdfb019bb8a85d4108"}
Jul 16 17:34:38.357717 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.357675    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-r6nfk" podStartSLOduration=65.287563627 podStartE2EDuration="1m7.357662866s" totalImagesPullingTime="2.070099239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:33:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:38.357400971 +0000 UTC m=+103.001623850" watchObservedRunningTime="2026-07-16 17:34:38.357662866 +0000 UTC m=+103.001885742"
Jul 16 17:34:38.712774 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.712714    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:38.782267 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:38.782215    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:39.246555 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:39.246523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:39.325451 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:39.325423    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:39.656580 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:39.656530    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:39.840657 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:39.840628    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:40.059280 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:40.059193    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:40.485087 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:40.485051    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:40.971703 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:40.971672    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:43.176738 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.176710    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-c6n29"]
Jul 16 17:34:43.178542 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.178526    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.185801 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.185781    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 16 17:34:43.185928 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.185809    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-8qwt4\""
Jul 16 17:34:43.185928 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.185781    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 16 17:34:43.203390 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.203356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-c6n29"]
Jul 16 17:34:43.246769 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.246744    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.246906 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.246839    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.289145 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.289120    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b9588ddf6-m8zqw"]
Jul 16 17:34:43.291052 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.291037    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.296562 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.296537    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 16 17:34:43.296936 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.296907    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 16 17:34:43.296936 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.296928    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 16 17:34:43.297387 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.297371    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dx8hw\""
Jul 16 17:34:43.304546 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.304526    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 16 17:34:43.309588 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.309568    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9588ddf6-m8zqw"]
Jul 16 17:34:43.347826 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.347800    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.347935 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.347854    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.348537 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.348514    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.350236 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.350210    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:43.350465 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.350451    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1b67646c-43f6-4729-a9dd-b0aa6bdda47c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-c6n29\" (UID: \"1b67646c-43f6-4729-a9dd-b0aa6bdda47c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.443952 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.443864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:43.448842 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.448823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-image-registry-private-configuration\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.448905 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.448854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-bound-sa-token\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.448905 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.448889    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-tls\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.448969 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.448941    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d8b9\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-kube-api-access-4d8b9\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.449002 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.448985    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-installation-pull-secrets\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.449036 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.449008    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-trusted-ca\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.449102 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.449090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-certificates\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.449136 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.449120    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54c0f925-b763-4fa7-8b82-a721d4d55d8f-ca-trust-extracted\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.486194 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.486166    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29"
Jul 16 17:34:43.549697 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.549669    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-bound-sa-token\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.549858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.549718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-tls\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.549858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.549763    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d8b9\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-kube-api-access-4d8b9\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.549974 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.549868    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-installation-pull-secrets\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.549974 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.549947    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-trusted-ca\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.550224 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.550198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-certificates\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.550397 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.550270    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54c0f925-b763-4fa7-8b82-a721d4d55d8f-ca-trust-extracted\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.550397 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.550330    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-image-registry-private-configuration\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.550757 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.550723    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/54c0f925-b763-4fa7-8b82-a721d4d55d8f-ca-trust-extracted\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.551073 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.551049    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-trusted-ca\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.551129 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.551052    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-certificates\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.552464 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.552446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-registry-tls\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.553026 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.552975    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-installation-pull-secrets\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.553121 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.553058    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/54c0f925-b763-4fa7-8b82-a721d4d55d8f-image-registry-private-configuration\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.565840 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.565813    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d8b9\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-kube-api-access-4d8b9\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.568410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.568391    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/54c0f925-b763-4fa7-8b82-a721d4d55d8f-bound-sa-token\") pod \"image-registry-5b9588ddf6-m8zqw\" (UID: \"54c0f925-b763-4fa7-8b82-a721d4d55d8f\") " pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.605220 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.605191    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:43.609477 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.609454    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-c6n29"]
Jul 16 17:34:43.742620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:43.742598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b9588ddf6-m8zqw"]
Jul 16 17:34:43.744831 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:43.744802    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c0f925_b763_4fa7_8b82_a721d4d55d8f.slice/crio-7f9a869a1c4329aee6d68e84319348c70bc80363f835f2d0be83038543be973b WatchSource:0}: Error finding container 7f9a869a1c4329aee6d68e84319348c70bc80363f835f2d0be83038543be973b: Status 404 returned error can't find the container with id 7f9a869a1c4329aee6d68e84319348c70bc80363f835f2d0be83038543be973b
Jul 16 17:34:44.341431 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:44.341393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw" event={"ID":"54c0f925-b763-4fa7-8b82-a721d4d55d8f","Type":"ContainerStarted","Data":"3432ed352b18d8333fa67308f23707a6f8d55af86cf6924aa9cb7861bf613016"}
Jul 16 17:34:44.341877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:44.341535    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:34:44.341877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:44.341572    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw" event={"ID":"54c0f925-b763-4fa7-8b82-a721d4d55d8f","Type":"ContainerStarted","Data":"7f9a869a1c4329aee6d68e84319348c70bc80363f835f2d0be83038543be973b"}
Jul 16 17:34:44.342486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:44.342466    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29" event={"ID":"1b67646c-43f6-4729-a9dd-b0aa6bdda47c","Type":"ContainerStarted","Data":"3602ea9d6c6d20920ad1ef13325ef36aacb4788e0cfe72de1a6ed4e582f5ee4d"}
Jul 16 17:34:44.366915 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:44.366872    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw" podStartSLOduration=1.36685698 podStartE2EDuration="1.36685698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:44.366023904 +0000 UTC m=+109.010246780" watchObservedRunningTime="2026-07-16 17:34:44.36685698 +0000 UTC m=+109.011079858"
Jul 16 17:34:45.266283 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.266255    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:45.268306 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.268272    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-ddcpz\" (UID: \"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:45.284165 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.284141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"
Jul 16 17:34:45.347738 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.347706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29" event={"ID":"1b67646c-43f6-4729-a9dd-b0aa6bdda47c","Type":"ContainerStarted","Data":"ffd1124a15dc0cdc2858911aa4a2f4f2ec6b408c0db5b4d7f5314ff64dc0ef3b"}
Jul 16 17:34:45.374501 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.374444    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-c6n29" podStartSLOduration=0.792350052 podStartE2EDuration="2.374420982s" totalImagesPullingTime="1.58207093s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:45.371235818 +0000 UTC m=+110.015458724" watchObservedRunningTime="2026-07-16 17:34:45.374420982 +0000 UTC m=+110.018643862"
Jul 16 17:34:45.407549 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.407517    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz"]
Jul 16 17:34:45.410415 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:45.410386    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1891b8fb_ab6f_4b42_a5dc_5ff2a1e712b6.slice/crio-800cc352c3bebbbc7852a77fe270d990c7648143e7f112831972ab955d0472bf WatchSource:0}: Error finding container 800cc352c3bebbbc7852a77fe270d990c7648143e7f112831972ab955d0472bf: Status 404 returned error can't find the container with id 800cc352c3bebbbc7852a77fe270d990c7648143e7f112831972ab955d0472bf
Jul 16 17:34:45.495866 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.495788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:45.568748 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:45.568724    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:46.352258 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:46.352224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz" event={"ID":"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6","Type":"ContainerStarted","Data":"800cc352c3bebbbc7852a77fe270d990c7648143e7f112831972ab955d0472bf"}
Jul 16 17:34:48.361481 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.361385    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz" event={"ID":"1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6","Type":"ContainerStarted","Data":"3db9ed90697b154e279b428743607a93268ea72e62cd43952cd1c18b801b11f0"}
Jul 16 17:34:48.388190 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.388124    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-ddcpz" podStartSLOduration=32.747589745 podStartE2EDuration="35.388102753s" totalImagesPullingTime="2.640513008s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:34:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:34:48.385801777 +0000 UTC m=+113.030024657" watchObservedRunningTime="2026-07-16 17:34:48.388102753 +0000 UTC m=+113.032325634"
Jul 16 17:34:48.505606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.505577    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:48.596884 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.596845    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:48.676665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.676630    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:48.813273 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:48.813244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:49.330742 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:49.330710    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-r6nfk"
Jul 16 17:34:50.402366 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:50.402332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:50.404565 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:50.404546    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e843a222-8ac1-471a-99a1-a690742e8b6b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6hc7d\" (UID: \"e843a222-8ac1-471a-99a1-a690742e8b6b\") " pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:50.448702 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:50.448675    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6hc7d"
Jul 16 17:34:50.598447 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:50.598425    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6hc7d"]
Jul 16 17:34:50.600619 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:34:50.600591    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode843a222_8ac1_471a_99a1_a690742e8b6b.slice/crio-e6f28cf4b784ce39de61d2f6a65f1b1487796b3d6333ffcabd564271cb2d6ca4 WatchSource:0}: Error finding container e6f28cf4b784ce39de61d2f6a65f1b1487796b3d6333ffcabd564271cb2d6ca4: Status 404 returned error can't find the container with id e6f28cf4b784ce39de61d2f6a65f1b1487796b3d6333ffcabd564271cb2d6ca4
Jul 16 17:34:51.372647 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:51.372569    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hc7d" event={"ID":"e843a222-8ac1-471a-99a1-a690742e8b6b","Type":"ContainerStarted","Data":"e6f28cf4b784ce39de61d2f6a65f1b1487796b3d6333ffcabd564271cb2d6ca4"}
Jul 16 17:34:51.636416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:51.636334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:51.723209 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:51.723174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:52.452712 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:52.452677    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:53.835120 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:53.835090    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:53.934843 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:53.934803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:55.092590 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:55.092559    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:55.175147 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:55.175111    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:55.278517 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:55.278489    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:55.697461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:55.697430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:56.393513 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:56.393465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hc7d" event={"ID":"e843a222-8ac1-471a-99a1-a690742e8b6b","Type":"ContainerStarted","Data":"1555a3e7a513e779489a7cc15c6fdf348e0181bafe1233dc67142d6bf6a3595c"}
Jul 16 17:34:58.568364 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:58.568334    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:58.670435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:58.670403    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:34:59.406410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:34:59.406345    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hc7d" event={"ID":"e843a222-8ac1-471a-99a1-a690742e8b6b","Type":"ContainerStarted","Data":"e9eccc1156621c972e2c933411d8aba249ed80f37b08e6dde047a81943e88973"}
Jul 16 17:35:00.557055 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:00.557023    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:00.674279 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:00.674240    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:02.446474 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:02.446432    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:02.549608 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:02.549576    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:04.177531 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:04.177473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:04.866568 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:04.866518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:04.962696 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:04.962664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:05.351945 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.351914    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b9588ddf6-m8zqw"
Jul 16 17:35:05.429606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.429522    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6hc7d" event={"ID":"e843a222-8ac1-471a-99a1-a690742e8b6b","Type":"ContainerStarted","Data":"d4b430b52f2c01c01e0a3fb2f29f53c6625bf55433200882bb897382b92deaac"}
Jul 16 17:35:05.475781 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.475735    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6hc7d" podStartSLOduration=33.023312645 podStartE2EDuration="47.475720171s" totalImagesPullingTime="14.452407526s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 17:34:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:05.475535647 +0000 UTC m=+130.119758528" watchObservedRunningTime="2026-07-16 17:35:05.475720171 +0000 UTC m=+130.119943049"
Jul 16 17:35:05.623823 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.623791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:05.624208 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.624189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:35:05.626391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.626371    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a77096c1-aac2-46ec-8239-b2515f2b081a-metrics-certs\") pod \"network-metrics-daemon-zq475\" (UID: \"a77096c1-aac2-46ec-8239-b2515f2b081a\") " pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:35:05.640657 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.640639    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-455gg\""
Jul 16 17:35:05.648107 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.648093    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zq475"
Jul 16 17:35:05.713479 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.713447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:05.789993 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.789965    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zq475"]
Jul 16 17:35:05.794143 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:35:05.794107    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda77096c1_aac2_46ec_8239_b2515f2b081a.slice/crio-6ea0f59c46dfd9316c5423062745b8454ff811808f4dc9c96d30f703cceee2ab WatchSource:0}: Error finding container 6ea0f59c46dfd9316c5423062745b8454ff811808f4dc9c96d30f703cceee2ab: Status 404 returned error can't find the container with id 6ea0f59c46dfd9316c5423062745b8454ff811808f4dc9c96d30f703cceee2ab
Jul 16 17:35:05.866059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.866034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:05.991346 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:05.991225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.148506 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.148470    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.270858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.270760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.343752 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.343721    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5zm9c"]
Jul 16 17:35:06.348395 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.348376    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.357573 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.357556    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 16 17:35:06.357952 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.357940    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 16 17:35:06.358340 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.358322    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kmqhb\""
Jul 16 17:35:06.358686 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.358673    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 16 17:35:06.363842 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.363827    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 16 17:35:06.376550 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.376523    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.428883 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.428850    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-textfile\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.428886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-root\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.428903    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-wtmp\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.428925    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.428982    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-sys\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.429009    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.429025    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-metrics-client-ca\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.429053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/bc724528-82ad-444c-9392-1e0ac69ef895-kube-api-access-fk76z\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.429137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.429079    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.436669 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.436643    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq475" event={"ID":"a77096c1-aac2-46ec-8239-b2515f2b081a","Type":"ContainerStarted","Data":"6ea0f59c46dfd9316c5423062745b8454ff811808f4dc9c96d30f703cceee2ab"}
Jul 16 17:35:06.475076 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.475046    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.530162 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530091    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-textfile\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530162 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530129    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-root\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530162 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530146    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-wtmp\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530200    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-root\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530238    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530276    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-sys\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530340    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-sys\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530366    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530373    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-wtmp\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530427 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-metrics-client-ca\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530729 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530443    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/bc724528-82ad-444c-9392-1e0ac69ef895-kube-api-access-fk76z\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530729 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:35:06.530472    2577 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 16 17:35:06.530729 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530729 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530481    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-textfile\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.530729 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:35:06.530531    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls podName:bc724528-82ad-444c-9392-1e0ac69ef895 nodeName:}" failed. No retries permitted until 2026-07-16 17:35:07.030511466 +0000 UTC m=+131.674734326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls") pod "node-exporter-5zm9c" (UID: "bc724528-82ad-444c-9392-1e0ac69ef895") : secret "node-exporter-tls" not found
Jul 16 17:35:06.531000 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.530982    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-metrics-client-ca\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.531038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.531023    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-accelerators-collector-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.532569 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.532553    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.546488 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.546466    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk76z\" (UniqueName: \"kubernetes.io/projected/bc724528-82ad-444c-9392-1e0ac69ef895-kube-api-access-fk76z\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:06.637969 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.637938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:06.941221 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:06.941187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:07.035392 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.035355    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:07.037964 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.037927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/bc724528-82ad-444c-9392-1e0ac69ef895-node-exporter-tls\") pod \"node-exporter-5zm9c\" (UID: \"bc724528-82ad-444c-9392-1e0ac69ef895\") " pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:07.041748 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.041690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:07.258410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.258380    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5zm9c"
Jul 16 17:35:07.269963 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:35:07.269941    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc724528_82ad_444c_9392_1e0ac69ef895.slice/crio-5e8014f316793fcac96c81c0f66a73c02eed68fc3f4f4c816bfc978d8c614697 WatchSource:0}: Error finding container 5e8014f316793fcac96c81c0f66a73c02eed68fc3f4f4c816bfc978d8c614697: Status 404 returned error can't find the container with id 5e8014f316793fcac96c81c0f66a73c02eed68fc3f4f4c816bfc978d8c614697
Jul 16 17:35:07.306002 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.305970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:07.442564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.442532    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq475" event={"ID":"a77096c1-aac2-46ec-8239-b2515f2b081a","Type":"ContainerStarted","Data":"37cfaa7f93d610d7c080b5e08c0d77da6b35792c3db8a08aa78d75555ff992a7"}
Jul 16 17:35:07.443073 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.442593    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zq475" event={"ID":"a77096c1-aac2-46ec-8239-b2515f2b081a","Type":"ContainerStarted","Data":"89a09825f0218bb69cb295139d25b244c0af281a6e251aeb708e796970db05e2"}
Jul 16 17:35:07.443996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.443970    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zm9c" event={"ID":"bc724528-82ad-444c-9392-1e0ac69ef895","Type":"ContainerStarted","Data":"5e8014f316793fcac96c81c0f66a73c02eed68fc3f4f4c816bfc978d8c614697"}
Jul 16 17:35:07.474834 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.474754    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zq475" podStartSLOduration=130.058292726 podStartE2EDuration="2m11.474739495s" totalImagesPullingTime="1.416446769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:07.471619919 +0000 UTC m=+132.115842798" watchObservedRunningTime="2026-07-16 17:35:07.474739495 +0000 UTC m=+132.118962431"
Jul 16 17:35:07.837871 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.837790    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:07.934067 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:07.934036    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:08.448779 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:08.448744    2577 generic.go:356] "Generic (PLEG): container finished" podID="bc724528-82ad-444c-9392-1e0ac69ef895" containerID="be993dfff8081747ec149d2728d9bf49b3d716272e4d7b6059329aad8a53a5b0" exitCode=0
Jul 16 17:35:08.449123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:08.448831    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zm9c" event={"ID":"bc724528-82ad-444c-9392-1e0ac69ef895","Type":"ContainerDied","Data":"be993dfff8081747ec149d2728d9bf49b3d716272e4d7b6059329aad8a53a5b0"}
Jul 16 17:35:09.237747 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.237720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:09.335645 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.335598    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:09.454308 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.454259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zm9c" event={"ID":"bc724528-82ad-444c-9392-1e0ac69ef895","Type":"ContainerStarted","Data":"b6770c4a6b465a61fedd614455a8fb8140b205703aaef0c9afc3d7d0784ba242"}
Jul 16 17:35:09.454735 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.454373    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5zm9c" event={"ID":"bc724528-82ad-444c-9392-1e0ac69ef895","Type":"ContainerStarted","Data":"b96aaa106cefbcf6b52cf43ff88dc912c2b6df9ba680685e343dfaa9fe06cf1f"}
Jul 16 17:35:09.485236 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.485187    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5zm9c" podStartSLOduration=2.489677572 podStartE2EDuration="3.485172104s" totalImagesPullingTime="931.325469ms" totalInitContainerRuntime="64.169063ms" isStatefulPod=true podCreationTimestamp="2026-07-16 17:35:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:09.483143264 +0000 UTC m=+134.127366143" watchObservedRunningTime="2026-07-16 17:35:09.485172104 +0000 UTC m=+134.129395009"
Jul 16 17:35:09.743829 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:09.743788    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:10.199064 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.199034    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:10.896040 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.896006    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:10.936909 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.936878    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"]
Jul 16 17:35:10.939859 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.939839    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:10.943578 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.943558    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 16 17:35:10.943578 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.943567    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8845f\""
Jul 16 17:35:10.955465 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.955441    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"]
Jul 16 17:35:10.963710 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.963692    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvqjg\" (UniqueName: \"kubernetes.io/projected/8e56e440-36d4-4504-8b6b-23fd24e438fe-kube-api-access-nvqjg\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:10.963802 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.963721    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:10.993980 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:10.993952    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:11.064564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.064534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvqjg\" (UniqueName: \"kubernetes.io/projected/8e56e440-36d4-4504-8b6b-23fd24e438fe-kube-api-access-nvqjg\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.064675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.064566    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.064743 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:35:11.064699    2577 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 16 17:35:11.064792 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:35:11.064769    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert podName:8e56e440-36d4-4504-8b6b-23fd24e438fe nodeName:}" failed. No retries permitted until 2026-07-16 17:35:11.564747882 +0000 UTC m=+136.208970743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-d7qb5" (UID: "8e56e440-36d4-4504-8b6b-23fd24e438fe") : secret "monitoring-plugin-cert" not found
Jul 16 17:35:11.074367 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.074339    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvqjg\" (UniqueName: \"kubernetes.io/projected/8e56e440-36d4-4504-8b6b-23fd24e438fe-kube-api-access-nvqjg\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.568504 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.568468    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.570784 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.570756    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/8e56e440-36d4-4504-8b6b-23fd24e438fe-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d7qb5\" (UID: \"8e56e440-36d4-4504-8b6b-23fd24e438fe\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.849163 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.849061    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:11.974681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:11.974658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"]
Jul 16 17:35:11.976643 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:35:11.976622    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e56e440_36d4_4504_8b6b_23fd24e438fe.slice/crio-a82b2f39c3d2b102065e4e718e9a2b13dbafdfb2a6a58092b4e25831ece4c6e6 WatchSource:0}: Error finding container a82b2f39c3d2b102065e4e718e9a2b13dbafdfb2a6a58092b4e25831ece4c6e6: Status 404 returned error can't find the container with id a82b2f39c3d2b102065e4e718e9a2b13dbafdfb2a6a58092b4e25831ece4c6e6
Jul 16 17:35:12.234807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:12.234776    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:12.336202 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:12.336170    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:12.466252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:12.466214    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5" event={"ID":"8e56e440-36d4-4504-8b6b-23fd24e438fe","Type":"ContainerStarted","Data":"a82b2f39c3d2b102065e4e718e9a2b13dbafdfb2a6a58092b4e25831ece4c6e6"}
Jul 16 17:35:12.863515 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:12.863487    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:13.473299 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:13.473204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5" event={"ID":"8e56e440-36d4-4504-8b6b-23fd24e438fe","Type":"ContainerStarted","Data":"5ede954a1983b864c369b30abd9492e25df01569ff7d19f18d6f4112011c9b87"}
Jul 16 17:35:13.473662 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:13.473418    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:13.477984 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:13.477963    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5"
Jul 16 17:35:13.495188 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:13.495146    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d7qb5" podStartSLOduration=2.280188714 podStartE2EDuration="3.49513255s" totalImagesPullingTime="1.214943836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:35:13.494424228 +0000 UTC m=+138.138647108" watchObservedRunningTime="2026-07-16 17:35:13.49513255 +0000 UTC m=+138.139355482"
Jul 16 17:35:16.200016 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:16.199980    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:16.290568 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:16.290527    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:20.179020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:20.178981    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:20.291455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:20.291421    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:22.379191 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:22.379158    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:22.480719 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:22.480690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:22.554059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:22.554031    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:28.635399 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:28.635349    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:29.279430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:29.279392    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:29.359533 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:29.359507    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:44.445187 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:44.445144    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:44.538885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:44.538852    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:47.585336 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:47.585239    2577 generic.go:356] "Generic (PLEG): container finished" podID="3cfd9de6-540a-4e23-93e9-4678db64f636" containerID="60d8c848e440550cb25322595a378150958a840160bf06d3e71f2b0d4ad1a2e9" exitCode=0
Jul 16 17:35:47.585336 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:47.585318    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2" event={"ID":"3cfd9de6-540a-4e23-93e9-4678db64f636","Type":"ContainerDied","Data":"60d8c848e440550cb25322595a378150958a840160bf06d3e71f2b0d4ad1a2e9"}
Jul 16 17:35:47.585938 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:47.585750    2577 scope.go:117] "RemoveContainer" containerID="60d8c848e440550cb25322595a378150958a840160bf06d3e71f2b0d4ad1a2e9"
Jul 16 17:35:48.589937 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:48.589899    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-g5vd2" event={"ID":"3cfd9de6-540a-4e23-93e9-4678db64f636","Type":"ContainerStarted","Data":"eb580a71d662cf9abe2efac246151f39b4a066720999cdb188261bb215094f4e"}
Jul 16 17:35:48.591197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:48.591175    2577 generic.go:356] "Generic (PLEG): container finished" podID="852c877c-5597-4f51-9540-13ea2ea6f28c" containerID="608e529f2d2f29cda018c32dfa98ad94b2e2b93a98015689462ee95ba1a6de05" exitCode=0
Jul 16 17:35:48.591279 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:48.591224    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c" event={"ID":"852c877c-5597-4f51-9540-13ea2ea6f28c","Type":"ContainerDied","Data":"608e529f2d2f29cda018c32dfa98ad94b2e2b93a98015689462ee95ba1a6de05"}
Jul 16 17:35:48.591495 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:48.591483    2577 scope.go:117] "RemoveContainer" containerID="608e529f2d2f29cda018c32dfa98ad94b2e2b93a98015689462ee95ba1a6de05"
Jul 16 17:35:49.596762 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:49.596728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-rwj5c" event={"ID":"852c877c-5597-4f51-9540-13ea2ea6f28c","Type":"ContainerStarted","Data":"5796858a9f55596dfdf1d584e81746cfb8b148625598551568755929958fc5aa"}
Jul 16 17:35:50.212820 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:50.212789    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:50.314446 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:50.314417    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:53.711883 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:53.711843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:35:54.020751 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:35:54.020669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:26.092413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:26.092374    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:26.165749 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:26.165690    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:26.241567 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:26.241532    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:34.540906 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:34.540872    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:34.616800 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:34.616774    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:45.699799 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:45.699761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:45.798224 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:45.798187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:45.877017 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:45.876985    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:49.581337 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:49.581271    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:36:49.654946 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:36:49.654912    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:20.034118 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:20.034038    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:20.103652 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:20.103623    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:32.987846 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:32.987808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:41.029050 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:41.029009    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:41.130545 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:41.130514    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:52.511059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:52.511022    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:52.984244 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:52.984211    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:53.057381 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:53.057354    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:55.743935 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:55.743907    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:37:55.746894 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:55.746868    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:37:55.747366 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:55.747347    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:37:55.750550 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:55.750530    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:37:55.754807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:55.754788    2577 kubelet.go:1648] "Image garbage collection succeeded"
Jul 16 17:37:57.625773 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:57.625740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:37:57.694180 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:37:57.694148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:03.007344 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:03.007310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:03.107298 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:03.107266    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:03.198411 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:03.198381    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:05.186108 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:05.186075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:05.284927 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:05.284896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:06.185626 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:06.185592    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:10.465048 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:10.465005    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:10.583900 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:10.583868    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:26.599561 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.599524    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:26.695112 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.695078    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"]
Jul 16 17:38:26.698588 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.695708    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:26.699784 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.699761    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.702992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.702973    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 16 17:38:26.704249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.704233    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 16 17:38:26.704326 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.704253    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 16 17:38:26.704326 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.704316    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 16 17:38:26.707153 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.706809    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"]
Jul 16 17:38:26.763337 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.763308    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:38:26.782220 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.782196    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e006b32b-569d-4fd5-b477-302067948540-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.782385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.782234    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e006b32b-569d-4fd5-b477-302067948540-tmp\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.782385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.782317    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpsmd\" (UniqueName: \"kubernetes.io/projected/e006b32b-569d-4fd5-b477-302067948540-kube-api-access-vpsmd\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.883239 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.883206    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e006b32b-569d-4fd5-b477-302067948540-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.883407 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.883249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e006b32b-569d-4fd5-b477-302067948540-tmp\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.883407 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.883332    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vpsmd\" (UniqueName: \"kubernetes.io/projected/e006b32b-569d-4fd5-b477-302067948540-kube-api-access-vpsmd\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.883695 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.883677    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e006b32b-569d-4fd5-b477-302067948540-tmp\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.885603 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.885584    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/e006b32b-569d-4fd5-b477-302067948540-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:26.893179 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:26.893159    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpsmd\" (UniqueName: \"kubernetes.io/projected/e006b32b-569d-4fd5-b477-302067948540-kube-api-access-vpsmd\") pod \"klusterlet-addon-workmgr-5bdc85f7dc-95fgn\" (UID: \"e006b32b-569d-4fd5-b477-302067948540\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:27.010164 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:27.010129    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:27.136900 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:27.136847    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"]
Jul 16 17:38:27.139574 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:38:27.139547    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode006b32b_569d_4fd5_b477_302067948540.slice/crio-14a8a102a85a5511be5466db8392ca14e5e0f8c3c775119272e67d7434fb3a58 WatchSource:0}: Error finding container 14a8a102a85a5511be5466db8392ca14e5e0f8c3c775119272e67d7434fb3a58: Status 404 returned error can't find the container with id 14a8a102a85a5511be5466db8392ca14e5e0f8c3c775119272e67d7434fb3a58
Jul 16 17:38:27.141777 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:27.141757    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:38:28.137839 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:28.137797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn" event={"ID":"e006b32b-569d-4fd5-b477-302067948540","Type":"ContainerStarted","Data":"14a8a102a85a5511be5466db8392ca14e5e0f8c3c775119272e67d7434fb3a58"}
Jul 16 17:38:33.157624 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:33.157586    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn" event={"ID":"e006b32b-569d-4fd5-b477-302067948540","Type":"ContainerStarted","Data":"f61c3e9ab01c13e7ba803b5bf02f28749a0d122c7a0a4849afb48bfeb1795bb4"}
Jul 16 17:38:33.157988 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:33.157770    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:33.159561 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:33.159542    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn"
Jul 16 17:38:33.182518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:38:33.182468    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bdc85f7dc-95fgn" podStartSLOduration=1.4828394999999999 podStartE2EDuration="7.182453827s" totalImagesPullingTime="5.699614327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:38:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:38:33.1818559 +0000 UTC m=+337.826078778" watchObservedRunningTime="2026-07-16 17:38:33.182453827 +0000 UTC m=+337.826676707"
Jul 16 17:39:06.458106 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:06.458018    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:08.691826 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:08.691795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:39:48.832161 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.832121    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"]
Jul 16 17:39:48.835428 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.835407    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.838269 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:39:48.838240    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:39:48.838388 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:39:48.838283    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"default-dockercfg-9cpnj\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cpnj\"" type="*v1.Secret"
Jul 16 17:39:48.838513 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:39:48.838492    2577 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 16 17:39:48.838567 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:39:48.838520    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-marketplace\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.849496 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.849472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"]
Jul 16 17:39:48.892087 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.892052    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.892248 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.892098    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgjb\" (UniqueName: \"kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.892248 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.892130    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.992529 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.992496    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.992691 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.992549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.992691 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.992579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgjb\" (UniqueName: \"kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.992948 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.992930    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:48.992984 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:48.992961    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:49.905773 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:49.905741    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 17:39:49.942416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:49.942390    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 17:39:49.946726 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:49.946700    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgjb\" (UniqueName: \"kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:50.293249 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:50.293170    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cpnj\""
Jul 16 17:39:50.295239 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:50.295220    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:39:50.417964 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:50.417936    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"]
Jul 16 17:39:50.420803 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:39:50.420778    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8778d7_21e4_43ad_a17c_76bd38fe5f1e.slice/crio-08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad WatchSource:0}: Error finding container 08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad: Status 404 returned error can't find the container with id 08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad
Jul 16 17:39:51.419624 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:51.419589    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx" event={"ID":"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e","Type":"ContainerStarted","Data":"08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad"}
Jul 16 17:39:58.450499 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:58.450467    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerID="7a6681566e8a3f6dff075e33a2e2084aca9d258db3af02e0fe3d93856f83cf52" exitCode=0
Jul 16 17:39:58.450870 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:39:58.450521    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx" event={"ID":"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e","Type":"ContainerDied","Data":"7a6681566e8a3f6dff075e33a2e2084aca9d258db3af02e0fe3d93856f83cf52"}
Jul 16 17:40:01.465343 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:01.465310    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerID="a27301fcd348fe84f60456b8a88b9cfdb3cacdef8bd00f6c62190bd411d954ee" exitCode=0
Jul 16 17:40:01.465714 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:01.465393    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx" event={"ID":"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e","Type":"ContainerDied","Data":"a27301fcd348fe84f60456b8a88b9cfdb3cacdef8bd00f6c62190bd411d954ee"}
Jul 16 17:40:09.498962 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:09.498924    2577 generic.go:356] "Generic (PLEG): container finished" podID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerID="8337253fdcbaaf687f3efe42488b0e2b398fdf8b176e213d82c8b6e87f679011" exitCode=0
Jul 16 17:40:09.499374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:09.499011    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx" event={"ID":"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e","Type":"ContainerDied","Data":"8337253fdcbaaf687f3efe42488b0e2b398fdf8b176e213d82c8b6e87f679011"}
Jul 16 17:40:10.629789 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.629763    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:40:10.761996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.761904    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util\") pod \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") "
Jul 16 17:40:10.761996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.761964    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle\") pod \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") "
Jul 16 17:40:10.761996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.761984    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gcgjb\" (UniqueName: \"kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb\") pod \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\" (UID: \"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e\") "
Jul 16 17:40:10.762620 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.762594    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle" (OuterVolumeSpecName: "bundle") pod "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" (UID: "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:10.764231 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.764204    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb" (OuterVolumeSpecName: "kube-api-access-gcgjb") pod "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" (UID: "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e"). InnerVolumeSpecName "kube-api-access-gcgjb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:40:10.766155 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.766133    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util" (OuterVolumeSpecName: "util") pod "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" (UID: "0e8778d7-21e4-43ad-a17c-76bd38fe5f1e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:10.862753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.862707    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:10.862753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.862747    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:10.862753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:10.862757    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gcgjb\" (UniqueName: \"kubernetes.io/projected/0e8778d7-21e4-43ad-a17c-76bd38fe5f1e-kube-api-access-gcgjb\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:11.508359 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:11.508325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx" event={"ID":"0e8778d7-21e4-43ad-a17c-76bd38fe5f1e","Type":"ContainerDied","Data":"08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad"}
Jul 16 17:40:11.508528 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:11.508374    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08d4b3772754f5b158aa0e2b54f7de71e9e17e23f0396cbf5f8caafb08666dad"
Jul 16 17:40:11.508528 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:11.508336    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540hrkmx"
Jul 16 17:40:14.921331 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:14.921300    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:15.934880 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:15.934847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:16.925173 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925140    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"]
Jul 16 17:40:16.925435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925423    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="extract"
Jul 16 17:40:16.925484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925437    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="extract"
Jul 16 17:40:16.925484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925447    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="util"
Jul 16 17:40:16.925484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925453    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="util"
Jul 16 17:40:16.925484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925460    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="pull"
Jul 16 17:40:16.925484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925465    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="pull"
Jul 16 17:40:16.925630 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.925516    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8778d7-21e4-43ad-a17c-76bd38fe5f1e" containerName="extract"
Jul 16 17:40:16.930349 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.930333    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:16.933372 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.933348    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 16 17:40:16.933482 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.933392    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wdvvg\""
Jul 16 17:40:16.933482 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.933438    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 16 17:40:16.940937 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:16.940907    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"]
Jul 16 17:40:17.010431 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.010398    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhm64\" (UniqueName: \"kubernetes.io/projected/63f0baa1-8588-4a3a-8fcf-53edfc758004-kube-api-access-hhm64\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.010612 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.010451    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63f0baa1-8588-4a3a-8fcf-53edfc758004-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.111607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.111570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63f0baa1-8588-4a3a-8fcf-53edfc758004-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.111789 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.111642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhm64\" (UniqueName: \"kubernetes.io/projected/63f0baa1-8588-4a3a-8fcf-53edfc758004-kube-api-access-hhm64\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.111995 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.111974    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63f0baa1-8588-4a3a-8fcf-53edfc758004-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.132774 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.132710    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhm64\" (UniqueName: \"kubernetes.io/projected/63f0baa1-8588-4a3a-8fcf-53edfc758004-kube-api-access-hhm64\") pod \"cert-manager-operator-controller-manager-55c444bf86-qqtdv\" (UID: \"63f0baa1-8588-4a3a-8fcf-53edfc758004\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.239764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.239682    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"
Jul 16 17:40:17.373197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.373095    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv"]
Jul 16 17:40:17.376043 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:40:17.376016    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63f0baa1_8588_4a3a_8fcf_53edfc758004.slice/crio-7ea85ca9802ecf134d9b62cdf9917f267e87a9f80a1cb844bb1baf9a34a694c6 WatchSource:0}: Error finding container 7ea85ca9802ecf134d9b62cdf9917f267e87a9f80a1cb844bb1baf9a34a694c6: Status 404 returned error can't find the container with id 7ea85ca9802ecf134d9b62cdf9917f267e87a9f80a1cb844bb1baf9a34a694c6
Jul 16 17:40:17.532216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:17.532139    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv" event={"ID":"63f0baa1-8588-4a3a-8fcf-53edfc758004","Type":"ContainerStarted","Data":"7ea85ca9802ecf134d9b62cdf9917f267e87a9f80a1cb844bb1baf9a34a694c6"}
Jul 16 17:40:18.529485 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:18.529454    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:18.592446 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:18.592419    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:23.316683 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:23.316629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:23.378821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:23.378783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:24.560751 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.560705    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv" event={"ID":"63f0baa1-8588-4a3a-8fcf-53edfc758004","Type":"ContainerStarted","Data":"e68381ab6bda10173483d7211beda4c9f7c941f921fea9818516ebe056015ca3"}
Jul 16 17:40:24.584193 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.584151    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-qqtdv" podStartSLOduration=1.962182063 podStartE2EDuration="8.584136971s" totalImagesPullingTime="6.621954908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:24.582785702 +0000 UTC m=+449.227008581" watchObservedRunningTime="2026-07-16 17:40:24.584136971 +0000 UTC m=+449.228359850"
Jul 16 17:40:24.724322 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.724278    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:24.832126 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.832025    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:24.909592 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.909557    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnlpc"]
Jul 16 17:40:24.911627 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.911610    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:24.914366 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.914344    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 16 17:40:24.914504 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.914390    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 16 17:40:24.914504 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.914450    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-lw242\""
Jul 16 17:40:24.924394 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.924372    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnlpc"]
Jul 16 17:40:24.971188 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.971158    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:24.971188 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:24.971192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b666b\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-kube-api-access-b666b\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.072006 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.071960    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.072006 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.072005    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b666b\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-kube-api-access-b666b\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.093339 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.093258    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.093618 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.093600    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b666b\" (UniqueName: \"kubernetes.io/projected/dc466be3-346f-4290-b5df-03f670bc8421-kube-api-access-b666b\") pod \"cert-manager-webhook-6486ffd997-lnlpc\" (UID: \"dc466be3-346f-4290-b5df-03f670bc8421\") " pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.100897 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.100869    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:25.195585 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.195549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:25.230586 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.230558    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:25.359824 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.359751    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-lnlpc"]
Jul 16 17:40:25.362607 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:40:25.362577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddc466be3_346f_4290_b5df_03f670bc8421.slice/crio-bc932344612f42102bf97d70102080cd2ceddb9c0b4b74905fefafa467e3d349 WatchSource:0}: Error finding container bc932344612f42102bf97d70102080cd2ceddb9c0b4b74905fefafa467e3d349: Status 404 returned error can't find the container with id bc932344612f42102bf97d70102080cd2ceddb9c0b4b74905fefafa467e3d349
Jul 16 17:40:25.566122 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:25.566089    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc" event={"ID":"dc466be3-346f-4290-b5df-03f670bc8421","Type":"ContainerStarted","Data":"bc932344612f42102bf97d70102080cd2ceddb9c0b4b74905fefafa467e3d349"}
Jul 16 17:40:26.532818 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.532780    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"]
Jul 16 17:40:26.535560 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.535539    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.540362 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.540342    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 17:40:26.541398 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.541364    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 17:40:26.542320 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.541840    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cpnj\""
Jul 16 17:40:26.549608 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.549583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"]
Jul 16 17:40:26.585845 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.585818    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.586201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.585856    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.586201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.585887    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nqkq\" (UniqueName: \"kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.686963 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.686929    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.687108 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.686973    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nqkq\" (UniqueName: \"kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.687108 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.687022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.687428 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.687408    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.687514 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.687495    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.696337 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.696315    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nqkq\" (UniqueName: \"kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.848937 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.848859    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:26.944644 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.944609    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:26.988611 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:26.988583    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"]
Jul 16 17:40:26.991578 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:40:26.991546    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62cea64_45e2_4f12_b680_31aa0c6cc624.slice/crio-415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887 WatchSource:0}: Error finding container 415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887: Status 404 returned error can't find the container with id 415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887
Jul 16 17:40:27.358406 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:27.358372    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:27.576246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:27.576213    2577 generic.go:356] "Generic (PLEG): container finished" podID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerID="f2a1404c3b1831eb53881040d039f3e82c7c452070c61b714d8292f6d619a2c5" exitCode=0
Jul 16 17:40:27.576246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:27.576252    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerDied","Data":"f2a1404c3b1831eb53881040d039f3e82c7c452070c61b714d8292f6d619a2c5"}
Jul 16 17:40:27.576513 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:27.576308    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerStarted","Data":"415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887"}
Jul 16 17:40:29.587679 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:29.587637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc" event={"ID":"dc466be3-346f-4290-b5df-03f670bc8421","Type":"ContainerStarted","Data":"28fdb3565d7ac7c58686bcbbe8d33bf0d7bbf6fe46e517428688bbb7bc4877ab"}
Jul 16 17:40:29.588169 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:29.587693    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:29.606823 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:29.606772    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc" podStartSLOduration=2.193837665 podStartE2EDuration="5.606755555s" totalImagesPullingTime="3.41291789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:29.60580476 +0000 UTC m=+454.250027640" watchObservedRunningTime="2026-07-16 17:40:29.606755555 +0000 UTC m=+454.250978433"
Jul 16 17:40:30.593436 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:30.593404    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerStarted","Data":"0e60512496d082c2a1f6d29e016a9ead2bb59e6f84c6fc64819873fe4733b6a0"}
Jul 16 17:40:31.298063 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.298033    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"]
Jul 16 17:40:31.300977 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.300957    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.304222 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.304203    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4xwz4\""
Jul 16 17:40:31.311961 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.311937    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"]
Jul 16 17:40:31.423929 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.423892    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.424102 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.423946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4ppt\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-kube-api-access-n4ppt\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.525218 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.525178    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4ppt\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-kube-api-access-n4ppt\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.525374 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.525252    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.535551 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.535521    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4ppt\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-kube-api-access-n4ppt\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.535690 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.535676    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0d36b16b-2fbc-42c0-b3c5-6815b099589d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-xq4qd\" (UID: \"0d36b16b-2fbc-42c0-b3c5-6815b099589d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.599314 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.599217    2577 generic.go:356] "Generic (PLEG): container finished" podID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerID="0e60512496d082c2a1f6d29e016a9ead2bb59e6f84c6fc64819873fe4733b6a0" exitCode=0
Jul 16 17:40:31.599660 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.599324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerDied","Data":"0e60512496d082c2a1f6d29e016a9ead2bb59e6f84c6fc64819873fe4733b6a0"}
Jul 16 17:40:31.609799 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.609778    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"
Jul 16 17:40:31.744181 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:31.744155    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd"]
Jul 16 17:40:31.746739 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:40:31.746703    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d36b16b_2fbc_42c0_b3c5_6815b099589d.slice/crio-563600c1e713767d28c77e2567a8c5e7fa4ddb3e8c9e71228f4b1e5ce575a7db WatchSource:0}: Error finding container 563600c1e713767d28c77e2567a8c5e7fa4ddb3e8c9e71228f4b1e5ce575a7db: Status 404 returned error can't find the container with id 563600c1e713767d28c77e2567a8c5e7fa4ddb3e8c9e71228f4b1e5ce575a7db
Jul 16 17:40:32.605031 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.604994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd" event={"ID":"0d36b16b-2fbc-42c0-b3c5-6815b099589d","Type":"ContainerStarted","Data":"125ac53e8ee517ff37a1e0588d1d351924094b2bdd2a4fa606e491b798efed2f"}
Jul 16 17:40:32.605472 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.605041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd" event={"ID":"0d36b16b-2fbc-42c0-b3c5-6815b099589d","Type":"ContainerStarted","Data":"563600c1e713767d28c77e2567a8c5e7fa4ddb3e8c9e71228f4b1e5ce575a7db"}
Jul 16 17:40:32.606993 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.606964    2577 generic.go:356] "Generic (PLEG): container finished" podID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerID="56b4de2ceab108760d24e1e8012c4b2e937a38e3f70f65fa6bb10ce28d9d8965" exitCode=0
Jul 16 17:40:32.607090 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.607038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerDied","Data":"56b4de2ceab108760d24e1e8012c4b2e937a38e3f70f65fa6bb10ce28d9d8965"}
Jul 16 17:40:32.624746 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.624705    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-xq4qd" podStartSLOduration=1.624691421 podStartE2EDuration="1.624691421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:40:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:40:32.623949537 +0000 UTC m=+457.268172418" watchObservedRunningTime="2026-07-16 17:40:32.624691421 +0000 UTC m=+457.268914299"
Jul 16 17:40:32.644528 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:32.644490    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:33.734366 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.734347    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:33.844354 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.844323    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util\") pod \"d62cea64-45e2-4f12-b680-31aa0c6cc624\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") "
Jul 16 17:40:33.844516 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.844370    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nqkq\" (UniqueName: \"kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq\") pod \"d62cea64-45e2-4f12-b680-31aa0c6cc624\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") "
Jul 16 17:40:33.844516 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.844397    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle\") pod \"d62cea64-45e2-4f12-b680-31aa0c6cc624\" (UID: \"d62cea64-45e2-4f12-b680-31aa0c6cc624\") "
Jul 16 17:40:33.844805 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.844783    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle" (OuterVolumeSpecName: "bundle") pod "d62cea64-45e2-4f12-b680-31aa0c6cc624" (UID: "d62cea64-45e2-4f12-b680-31aa0c6cc624"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:33.846332 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.846306    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq" (OuterVolumeSpecName: "kube-api-access-4nqkq") pod "d62cea64-45e2-4f12-b680-31aa0c6cc624" (UID: "d62cea64-45e2-4f12-b680-31aa0c6cc624"). InnerVolumeSpecName "kube-api-access-4nqkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:40:33.851242 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.851215    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util" (OuterVolumeSpecName: "util") pod "d62cea64-45e2-4f12-b680-31aa0c6cc624" (UID: "d62cea64-45e2-4f12-b680-31aa0c6cc624"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:33.945773 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.945749    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:33.945773 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.945772    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nqkq\" (UniqueName: \"kubernetes.io/projected/d62cea64-45e2-4f12-b680-31aa0c6cc624-kube-api-access-4nqkq\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:33.945910 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:33.945781    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d62cea64-45e2-4f12-b680-31aa0c6cc624-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:34.617165 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:34.617136    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2"
Jul 16 17:40:34.617165 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:34.617149    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fm2hq2" event={"ID":"d62cea64-45e2-4f12-b680-31aa0c6cc624","Type":"ContainerDied","Data":"415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887"}
Jul 16 17:40:34.617385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:34.617194    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="415d0dcb171dd1c8bfeb26ff63a364f9a402878b240c1c0d1780e17146939887"
Jul 16 17:40:35.595996 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:35.595969    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-lnlpc"
Jul 16 17:40:35.619720 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:35.619679    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:38.025066 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:38.025003    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:38.116950 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:38.116917    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:44.188572 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:44.188533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:44.420984 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:44.420949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:45.861766 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.861726    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"]
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862018    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="pull"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862028    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="pull"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862038    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="extract"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862043    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="extract"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862052    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="util"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862058    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="util"
Jul 16 17:40:45.862149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.862100    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d62cea64-45e2-4f12-b680-31aa0c6cc624" containerName="extract"
Jul 16 17:40:45.905682 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.905656    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"]
Jul 16 17:40:45.905864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.905760    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:45.908805 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.908783    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 16 17:40:45.909045 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.909031    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9cpnj\""
Jul 16 17:40:45.910194 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:45.910172    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 16 17:40:46.043410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.043374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7468t\" (UniqueName: \"kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.043584 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.043527    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.043584 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.043562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.144444 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.144416    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.144592 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.144450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.144592 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.144505    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7468t\" (UniqueName: \"kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.144793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.144776    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.144829 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.144807    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.156209 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.156178    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7468t\" (UniqueName: \"kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.216348 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.216317    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:46.322476 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.322442    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:46.379861 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.379834    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"]
Jul 16 17:40:46.382164 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:40:46.382138    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod540bd632_5729_427a_91a3_c6fc1d24e692.slice/crio-c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80 WatchSource:0}: Error finding container c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80: Status 404 returned error can't find the container with id c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80
Jul 16 17:40:46.665688 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.665658    2577 generic.go:356] "Generic (PLEG): container finished" podID="540bd632-5729-427a-91a3-c6fc1d24e692" containerID="78729efb4541e36b86d3dcd88d04d4b437e94b6285681ca54e0e57a84ce3a057" exitCode=0
Jul 16 17:40:46.665868 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.665742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh" event={"ID":"540bd632-5729-427a-91a3-c6fc1d24e692","Type":"ContainerDied","Data":"78729efb4541e36b86d3dcd88d04d4b437e94b6285681ca54e0e57a84ce3a057"}
Jul 16 17:40:46.665868 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:46.665787    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh" event={"ID":"540bd632-5729-427a-91a3-c6fc1d24e692","Type":"ContainerStarted","Data":"c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80"}
Jul 16 17:40:47.672606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:47.672570    2577 generic.go:356] "Generic (PLEG): container finished" podID="540bd632-5729-427a-91a3-c6fc1d24e692" containerID="0d061a83902d20dd7ec28483b4afb6452d5008329613a926709da52306085f6f" exitCode=0
Jul 16 17:40:47.672606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:47.672607    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh" event={"ID":"540bd632-5729-427a-91a3-c6fc1d24e692","Type":"ContainerDied","Data":"0d061a83902d20dd7ec28483b4afb6452d5008329613a926709da52306085f6f"}
Jul 16 17:40:48.678439 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:48.678410    2577 generic.go:356] "Generic (PLEG): container finished" podID="540bd632-5729-427a-91a3-c6fc1d24e692" containerID="7dbaaacde884dba9b99abcc2712c1524a8c47b7882c0b51e86f1a37b95101d79" exitCode=0
Jul 16 17:40:48.678821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:48.678483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh" event={"ID":"540bd632-5729-427a-91a3-c6fc1d24e692","Type":"ContainerDied","Data":"7dbaaacde884dba9b99abcc2712c1524a8c47b7882c0b51e86f1a37b95101d79"}
Jul 16 17:40:49.810052 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.810027    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:49.975157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.975061    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7468t\" (UniqueName: \"kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t\") pod \"540bd632-5729-427a-91a3-c6fc1d24e692\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") "
Jul 16 17:40:49.975157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.975118    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util\") pod \"540bd632-5729-427a-91a3-c6fc1d24e692\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") "
Jul 16 17:40:49.975409 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.975217    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle\") pod \"540bd632-5729-427a-91a3-c6fc1d24e692\" (UID: \"540bd632-5729-427a-91a3-c6fc1d24e692\") "
Jul 16 17:40:49.975903 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.975872    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle" (OuterVolumeSpecName: "bundle") pod "540bd632-5729-427a-91a3-c6fc1d24e692" (UID: "540bd632-5729-427a-91a3-c6fc1d24e692"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:49.977123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.977095    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t" (OuterVolumeSpecName: "kube-api-access-7468t") pod "540bd632-5729-427a-91a3-c6fc1d24e692" (UID: "540bd632-5729-427a-91a3-c6fc1d24e692"). InnerVolumeSpecName "kube-api-access-7468t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:40:49.983885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:49.983846    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util" (OuterVolumeSpecName: "util") pod "540bd632-5729-427a-91a3-c6fc1d24e692" (UID: "540bd632-5729-427a-91a3-c6fc1d24e692"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:40:50.076387 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.076354    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:50.076387 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.076381    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7468t\" (UniqueName: \"kubernetes.io/projected/540bd632-5729-427a-91a3-c6fc1d24e692-kube-api-access-7468t\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:50.076387 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.076391    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/540bd632-5729-427a-91a3-c6fc1d24e692-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:40:50.689642 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.689608    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh" event={"ID":"540bd632-5729-427a-91a3-c6fc1d24e692","Type":"ContainerDied","Data":"c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80"}
Jul 16 17:40:50.689642 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.689639    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af8b7vh"
Jul 16 17:40:50.689854 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:50.689662    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2244311c8e5c3049b93bd3c78fcce0c546c59d23bbbfacbef12b76c5c289a80"
Jul 16 17:40:52.563797 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:52.563763    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:53.277732 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:53.277700    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:40:59.830847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:40:59.830808    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.374170 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.374126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.482022 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.481994    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.646926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.646835    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.754012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.753983    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.777093 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777065    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"]
Jul 16 17:41:00.777462 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777445    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="extract"
Jul 16 17:41:00.777570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777464    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="extract"
Jul 16 17:41:00.777570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777487    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="pull"
Jul 16 17:41:00.777570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777495    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="pull"
Jul 16 17:41:00.777570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777522    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="util"
Jul 16 17:41:00.777570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777531    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="util"
Jul 16 17:41:00.777804 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.777603    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="540bd632-5729-427a-91a3-c6fc1d24e692" containerName="extract"
Jul 16 17:41:00.780000 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.779982    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.784431 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.784412    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 16 17:41:00.784534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.784513    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 16 17:41:00.784598 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.784549    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 16 17:41:00.784759 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.784742    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-n44d8\""
Jul 16 17:41:00.785081 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.785069    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 16 17:41:00.797550 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.797528    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"]
Jul 16 17:41:00.857277 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.857249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.857277 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.857281    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g28fw\" (UniqueName: \"kubernetes.io/projected/29347a2e-12b1-49b6-8900-0c54eb05c2ed-kube-api-access-g28fw\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.857673 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.857334    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.857673 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.857361    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.857673 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.857389    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.957229 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.957147    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:00.958167 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.958220 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958202    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.958258 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g28fw\" (UniqueName: \"kubernetes.io/projected/29347a2e-12b1-49b6-8900-0c54eb05c2ed-kube-api-access-g28fw\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.958258 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958249    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.958388 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958267    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.958712 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.958689    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-manifests\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.960539 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.960517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-apiservice-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.960648 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.960630    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/29347a2e-12b1-49b6-8900-0c54eb05c2ed-webhook-cert\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.960705 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.960636    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/29347a2e-12b1-49b6-8900-0c54eb05c2ed-tmp\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:00.969218 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:00.969195    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g28fw\" (UniqueName: \"kubernetes.io/projected/29347a2e-12b1-49b6-8900-0c54eb05c2ed-kube-api-access-g28fw\") pod \"opendatahub-operator-controller-manager-674ff8dd58-p4gvk\" (UID: \"29347a2e-12b1-49b6-8900-0c54eb05c2ed\") " pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:01.054368 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.054333    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:01.089502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.089469    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:01.153622 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.153564    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:01.233343 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.233317    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"]
Jul 16 17:41:01.235371 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:01.235342    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29347a2e_12b1_49b6_8900_0c54eb05c2ed.slice/crio-0c7dec83d1e2cd58b7a8067b846aa8369485239b825ebc8d0b6a4aa4b09a6359 WatchSource:0}: Error finding container 0c7dec83d1e2cd58b7a8067b846aa8369485239b825ebc8d0b6a4aa4b09a6359: Status 404 returned error can't find the container with id 0c7dec83d1e2cd58b7a8067b846aa8369485239b825ebc8d0b6a4aa4b09a6359
Jul 16 17:41:01.239936 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.239910    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:01.309989 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.309961    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:01.416161 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.416121    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:01.737576 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:01.737545    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk" event={"ID":"29347a2e-12b1-49b6-8900-0c54eb05c2ed","Type":"ContainerStarted","Data":"0c7dec83d1e2cd58b7a8067b846aa8369485239b825ebc8d0b6a4aa4b09a6359"}
Jul 16 17:41:04.752227 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:04.752189    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk" event={"ID":"29347a2e-12b1-49b6-8900-0c54eb05c2ed","Type":"ContainerStarted","Data":"7e0347bb09c11bf1f8dea3858ea9cdefc87ead98ef3aa763c9a6f72a4f9f24db"}
Jul 16 17:41:05.757581 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:05.757552    2577 generic.go:356] "Generic (PLEG): container finished" podID="29347a2e-12b1-49b6-8900-0c54eb05c2ed" containerID="7e0347bb09c11bf1f8dea3858ea9cdefc87ead98ef3aa763c9a6f72a4f9f24db" exitCode=0
Jul 16 17:41:05.757926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:05.757637    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk" event={"ID":"29347a2e-12b1-49b6-8900-0c54eb05c2ed","Type":"ContainerDied","Data":"7e0347bb09c11bf1f8dea3858ea9cdefc87ead98ef3aa763c9a6f72a4f9f24db"}
Jul 16 17:41:06.765475 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:06.765381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk" event={"ID":"29347a2e-12b1-49b6-8900-0c54eb05c2ed","Type":"ContainerStarted","Data":"5d812e6cc01f50878d6a65a2647e9125e6d953f43feb5f51e29f15116c73948b"}
Jul 16 17:41:06.765839 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:06.765552    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:06.793534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:06.793478    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk" podStartSLOduration=1.6599248869999998 podStartE2EDuration="6.793462514s" totalImagesPullingTime="4.045638764s" totalInitContainerRuntime="1.087898863s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:06.792494833 +0000 UTC m=+491.436717713" watchObservedRunningTime="2026-07-16 17:41:06.793462514 +0000 UTC m=+491.437685393"
Jul 16 17:41:13.211415 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:13.211384    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:14.006860 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:14.006828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:17.772353 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:17.772324    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-674ff8dd58-p4gvk"
Jul 16 17:41:20.493608 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:20.493569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:20.599573 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:20.599538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:20.952139 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:20.952099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:21.109469 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.109439    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"]
Jul 16 17:41:21.111811 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.111790    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.115407 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.115380    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 16 17:41:21.115522 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.115415    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 16 17:41:21.116614 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.116598    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 16 17:41:21.116707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.116654    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 16 17:41:21.133625 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.133598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"]
Jul 16 17:41:21.186315 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.186257    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:21.220665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.220585    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7j8f\" (UniqueName: \"kubernetes.io/projected/0e985eb5-146c-4b58-aa8f-712d8c650e44-kube-api-access-x7j8f\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.220665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.220626    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e985eb5-146c-4b58-aa8f-712d8c650e44-tmp\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.220665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.220652    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e985eb5-146c-4b58-aa8f-712d8c650e44-tls-certs\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.321672 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.321642    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e985eb5-146c-4b58-aa8f-712d8c650e44-tls-certs\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.321875 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.321730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7j8f\" (UniqueName: \"kubernetes.io/projected/0e985eb5-146c-4b58-aa8f-712d8c650e44-kube-api-access-x7j8f\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.321875 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.321775    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e985eb5-146c-4b58-aa8f-712d8c650e44-tmp\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.323949 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.323916    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0e985eb5-146c-4b58-aa8f-712d8c650e44-tmp\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.324050 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.324019    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0e985eb5-146c-4b58-aa8f-712d8c650e44-tls-certs\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.336699 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.336665    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7j8f\" (UniqueName: \"kubernetes.io/projected/0e985eb5-146c-4b58-aa8f-712d8c650e44-kube-api-access-x7j8f\") pod \"kube-auth-proxy-5966557cf8-wwkh8\" (UID: \"0e985eb5-146c-4b58-aa8f-712d8c650e44\") " pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.393837 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.393799    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mm9zq"]
Jul 16 17:41:21.395994 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.395976    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.399853 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.399833    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 16 17:41:21.400002 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.399862    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-9wt7h\""
Jul 16 17:41:21.413500 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.413471    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mm9zq"]
Jul 16 17:41:21.421726 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.421688    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"
Jul 16 17:41:21.440465 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.440414    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:21.523815 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.523786    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2927\" (UniqueName: \"kubernetes.io/projected/fe6ee77c-6c28-4102-a478-992a05c04b29-kube-api-access-n2927\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.524158 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.523899    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe6ee77c-6c28-4102-a478-992a05c04b29-cert\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.533525 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.533493    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:21.567100 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.567071    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8"]
Jul 16 17:41:21.570083 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:21.570056    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e985eb5_146c_4b58_aa8f_712d8c650e44.slice/crio-6d36a2a6ffed40598e89a2c1f202be654e0b2dae19a24e1d9f837e1e1c1813d6 WatchSource:0}: Error finding container 6d36a2a6ffed40598e89a2c1f202be654e0b2dae19a24e1d9f837e1e1c1813d6: Status 404 returned error can't find the container with id 6d36a2a6ffed40598e89a2c1f202be654e0b2dae19a24e1d9f837e1e1c1813d6
Jul 16 17:41:21.624509 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.624475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe6ee77c-6c28-4102-a478-992a05c04b29-cert\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.624675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.624534    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2927\" (UniqueName: \"kubernetes.io/projected/fe6ee77c-6c28-4102-a478-992a05c04b29-kube-api-access-n2927\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.626891 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.626865    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe6ee77c-6c28-4102-a478-992a05c04b29-cert\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.629714 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.629682    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:21.634460 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.634442    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2927\" (UniqueName: \"kubernetes.io/projected/fe6ee77c-6c28-4102-a478-992a05c04b29-kube-api-access-n2927\") pod \"odh-model-controller-7998c67dc4-mm9zq\" (UID: \"fe6ee77c-6c28-4102-a478-992a05c04b29\") " pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.709506 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.709476    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:21.830398 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.830363    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8" event={"ID":"0e985eb5-146c-4b58-aa8f-712d8c650e44","Type":"ContainerStarted","Data":"6d36a2a6ffed40598e89a2c1f202be654e0b2dae19a24e1d9f837e1e1c1813d6"}
Jul 16 17:41:21.852041 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:21.852015    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mm9zq"]
Jul 16 17:41:21.853811 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:21.853787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe6ee77c_6c28_4102_a478_992a05c04b29.slice/crio-dc8a72b72141755c56d87a7e17bd32b6c8f6f250175fbdaf11b4ede11635faaa WatchSource:0}: Error finding container dc8a72b72141755c56d87a7e17bd32b6c8f6f250175fbdaf11b4ede11635faaa: Status 404 returned error can't find the container with id dc8a72b72141755c56d87a7e17bd32b6c8f6f250175fbdaf11b4ede11635faaa
Jul 16 17:41:22.241580 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.241541    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:22.300252 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.300219    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvrrq"]
Jul 16 17:41:22.302938 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.302924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.307136 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.307117    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 16 17:41:22.307494 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.307478    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6v6rd\""
Jul 16 17:41:22.314348 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.314330    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvrrq"]
Jul 16 17:41:22.420392 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.420356    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:22.430593 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.430562    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e44210-8c65-4186-bbf7-f29c151b1d0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.430765 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.430682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jhd5\" (UniqueName: \"kubernetes.io/projected/70e44210-8c65-4186-bbf7-f29c151b1d0f-kube-api-access-2jhd5\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.531814 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.531725    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jhd5\" (UniqueName: \"kubernetes.io/projected/70e44210-8c65-4186-bbf7-f29c151b1d0f-kube-api-access-2jhd5\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.532201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.531825    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e44210-8c65-4186-bbf7-f29c151b1d0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.534499 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.534458    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70e44210-8c65-4186-bbf7-f29c151b1d0f-tls-certs\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.547847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.547824    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jhd5\" (UniqueName: \"kubernetes.io/projected/70e44210-8c65-4186-bbf7-f29c151b1d0f-kube-api-access-2jhd5\") pod \"model-serving-api-54d89bd5fc-tvrrq\" (UID: \"70e44210-8c65-4186-bbf7-f29c151b1d0f\") " pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.584982 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.584921    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:22.605753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.605716    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:22.609052 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.609024    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.611866 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.611811    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 16 17:41:22.611866 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.611829    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 16 17:41:22.612475 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.612285    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-bmmjr\""
Jul 16 17:41:22.612475 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.612333    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 16 17:41:22.612646 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.612484    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 16 17:41:22.613302 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.613233    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:22.627767 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.627739    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:22.665621 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.665313    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hljvs\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734153    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734195    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734227    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.739317 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.734277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.794991 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.794971    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-tvrrq"]
Jul 16 17:41:22.798017 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:22.797784    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70e44210_8c65_4186_bbf7_f29c151b1d0f.slice/crio-303df8488d57ba04712e0bdaf288a746322149a39f8a682f9e88b4a7da0db357 WatchSource:0}: Error finding container 303df8488d57ba04712e0bdaf288a746322149a39f8a682f9e88b4a7da0db357: Status 404 returned error can't find the container with id 303df8488d57ba04712e0bdaf288a746322149a39f8a682f9e88b4a7da0db357
Jul 16 17:41:22.835391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835359    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835403    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hljvs\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835546    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.835634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.835592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.836819 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.836238    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.844065 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.844006    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.845875 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.845834    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.846959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.846462    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq" event={"ID":"fe6ee77c-6c28-4102-a478-992a05c04b29","Type":"ContainerStarted","Data":"dc8a72b72141755c56d87a7e17bd32b6c8f6f250175fbdaf11b4ede11635faaa"}
Jul 16 17:41:22.846959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.846921    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.848034 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.847637    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hljvs\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.848034 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.848000    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.848797 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.848738    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-8lfkz\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:22.849724 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.849658    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq" event={"ID":"70e44210-8c65-4186-bbf7-f29c151b1d0f","Type":"ContainerStarted","Data":"303df8488d57ba04712e0bdaf288a746322149a39f8a682f9e88b4a7da0db357"}
Jul 16 17:41:22.923446 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:22.923175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:23.132122 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:23.131973    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:23.135980 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:23.135949    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a805e47_ee2d_4e88_be11_66f39752357e.slice/crio-76ffe247ae86ace1fc6eb1f336c4c82c3123d9f41131919d3b43728de6592d06 WatchSource:0}: Error finding container 76ffe247ae86ace1fc6eb1f336c4c82c3123d9f41131919d3b43728de6592d06: Status 404 returned error can't find the container with id 76ffe247ae86ace1fc6eb1f336c4c82c3123d9f41131919d3b43728de6592d06
Jul 16 17:41:23.784900 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:23.784843    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:23.859157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:23.859082    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" event={"ID":"1a805e47-ee2d-4e88-be11-66f39752357e","Type":"ContainerStarted","Data":"76ffe247ae86ace1fc6eb1f336c4c82c3123d9f41131919d3b43728de6592d06"}
Jul 16 17:41:26.878731 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.878694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8" event={"ID":"0e985eb5-146c-4b58-aa8f-712d8c650e44","Type":"ContainerStarted","Data":"fe3ba97648af084b5ad577005e6cfc86033273fdc0b421f652132c2a3e1560aa"}
Jul 16 17:41:26.880416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.880381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq" event={"ID":"fe6ee77c-6c28-4102-a478-992a05c04b29","Type":"ContainerStarted","Data":"abd50b33c3bb5f2b1b19b994ecab9c3ae1e7be4be0ce1b3040102699f89134e3"}
Jul 16 17:41:26.880557 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.880455    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:26.882087 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.882064    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq" event={"ID":"70e44210-8c65-4186-bbf7-f29c151b1d0f","Type":"ContainerStarted","Data":"744f3b96271dca4d23dd8b623bbcad322a65e46a41c3418b69b76f3a585f758c"}
Jul 16 17:41:26.882184 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.882172    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:26.900502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.900456    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5966557cf8-wwkh8" podStartSLOduration=1.185574299 podStartE2EDuration="5.900438451s" totalImagesPullingTime="4.714864152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:26.897996944 +0000 UTC m=+511.542219824" watchObservedRunningTime="2026-07-16 17:41:26.900438451 +0000 UTC m=+511.544661329"
Jul 16 17:41:26.915981 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.915921    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq" podStartSLOduration=1.493616986 podStartE2EDuration="5.915901832s" totalImagesPullingTime="4.422284846s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:26.915781564 +0000 UTC m=+511.560004462" watchObservedRunningTime="2026-07-16 17:41:26.915901832 +0000 UTC m=+511.560124711"
Jul 16 17:41:26.937080 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:26.937031    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq" podStartSLOduration=1.455379838 podStartE2EDuration="4.937010636s" totalImagesPullingTime="3.481630798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:26.936034632 +0000 UTC m=+511.580257515" watchObservedRunningTime="2026-07-16 17:41:26.937010636 +0000 UTC m=+511.581233526"
Jul 16 17:41:27.834081 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:27.834036    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 17:41:27.834198 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:27.834106    2577 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 16 17:41:28.892088 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:28.892041    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" event={"ID":"1a805e47-ee2d-4e88-be11-66f39752357e","Type":"ContainerStarted","Data":"2d4a7b5489058d19da39ff3c989bd23ffb03ff4392ee4d263ed4c116cc79b904"}
Jul 16 17:41:28.892506 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:28.892182    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:28.893979 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:28.893949    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8lfkz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 17:41:28.894075 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:28.894004    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 17:41:28.924704 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:28.924653    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" podStartSLOduration=2.229630105 podStartE2EDuration="6.924633869s" totalImagesPullingTime="4.695003764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:28.923018651 +0000 UTC m=+513.567241529" watchObservedRunningTime="2026-07-16 17:41:28.924633869 +0000 UTC m=+513.568856750"
Jul 16 17:41:29.332465 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:29.332372    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:29.427836 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:29.427791    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:29.897553 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:29.897523    2577 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-8lfkz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 16 17:41:29.897930 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:29.897575    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 16 17:41:30.421059 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:30.421028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:30.647277 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:30.647242    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:30.773231 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:30.773147    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:32.897677 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:32.897647    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:33.880349 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:33.880310    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:33.998185 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:33.998146    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:34.010765 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.010737    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"]
Jul 16 17:41:34.013999 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.013983    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.017995 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.017975    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 16 17:41:34.018950 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.018934    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hmvsw\""
Jul 16 17:41:34.025358 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.025338    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"]
Jul 16 17:41:34.028593 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.028571    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.030563 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.030544    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"]
Jul 16 17:41:34.031671 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.031654    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 16 17:41:34.031918 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.031862    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-t284x\""
Jul 16 17:41:34.048276 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.048250    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"]
Jul 16 17:41:34.101707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.101678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:34.138681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.138600    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e4f34dd-7520-4cb8-813c-f8c7f4139170-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.138681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.138638    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.138681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.138666    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7mhf\" (UniqueName: \"kubernetes.io/projected/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-kube-api-access-g7mhf\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.138880 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.138774    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgs8t\" (UniqueName: \"kubernetes.io/projected/0e4f34dd-7520-4cb8-813c-f8c7f4139170-kube-api-access-bgs8t\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.180644 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.180608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:34.239368 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.239334    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgs8t\" (UniqueName: \"kubernetes.io/projected/0e4f34dd-7520-4cb8-813c-f8c7f4139170-kube-api-access-bgs8t\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.239524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.239411    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e4f34dd-7520-4cb8-813c-f8c7f4139170-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.239524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.239432    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.239524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.239451    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7mhf\" (UniqueName: \"kubernetes.io/projected/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-kube-api-access-g7mhf\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.239638 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:41:34.239561    2577 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 16 17:41:34.239728 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:41:34.239637    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert podName:7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6 nodeName:}" failed. No retries permitted until 2026-07-16 17:41:34.739616526 +0000 UTC m=+519.383839383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert") pod "llmisvc-controller-manager-777c6bd7d5-kk9hf" (UID: "7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6") : secret "llmisvc-webhook-server-cert" not found
Jul 16 17:41:34.242086 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.242065    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0e4f34dd-7520-4cb8-813c-f8c7f4139170-cert\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.251607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.251585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgs8t\" (UniqueName: \"kubernetes.io/projected/0e4f34dd-7520-4cb8-813c-f8c7f4139170-kube-api-access-bgs8t\") pod \"kserve-controller-manager-d6f4b65b8-d7r8c\" (UID: \"0e4f34dd-7520-4cb8-813c-f8c7f4139170\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.264841 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.264818    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7mhf\" (UniqueName: \"kubernetes.io/projected/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-kube-api-access-g7mhf\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.324548 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.324518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:34.343974 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.343941    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:34.469651 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.469628    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"]
Jul 16 17:41:34.471988 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:34.471962    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e4f34dd_7520_4cb8_813c_f8c7f4139170.slice/crio-7f2d209c3b951224c8d53bd8f3598370326b35dd89202a7ddb85e3c31dbc181b WatchSource:0}: Error finding container 7f2d209c3b951224c8d53bd8f3598370326b35dd89202a7ddb85e3c31dbc181b: Status 404 returned error can't find the container with id 7f2d209c3b951224c8d53bd8f3598370326b35dd89202a7ddb85e3c31dbc181b
Jul 16 17:41:34.742628 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.742547    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.744877 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.744858    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-kk9hf\" (UID: \"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:34.923471 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.923439    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c" event={"ID":"0e4f34dd-7520-4cb8-813c-f8c7f4139170","Type":"ContainerStarted","Data":"7f2d209c3b951224c8d53bd8f3598370326b35dd89202a7ddb85e3c31dbc181b"}
Jul 16 17:41:34.940597 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:34.940570    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:35.093685 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:35.093598    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"]
Jul 16 17:41:35.096040 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:41:35.096016    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7d3d39d2_7be5_4f84_9d94_43b0c4c3efd6.slice/crio-4bb35f98398d50e8ae00ecce0512ab81204a7e60a981c179d52089fc04f0f5c7 WatchSource:0}: Error finding container 4bb35f98398d50e8ae00ecce0512ab81204a7e60a981c179d52089fc04f0f5c7: Status 404 returned error can't find the container with id 4bb35f98398d50e8ae00ecce0512ab81204a7e60a981c179d52089fc04f0f5c7
Jul 16 17:41:35.932318 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:35.932258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf" event={"ID":"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6","Type":"ContainerStarted","Data":"4bb35f98398d50e8ae00ecce0512ab81204a7e60a981c179d52089fc04f0f5c7"}
Jul 16 17:41:36.204517 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.204422    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:36.403383 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.403350    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:36.504145 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.504055    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:36.689029 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.688993    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:36.689271 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.689205    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery" containerID="cri-o://2d4a7b5489058d19da39ff3c989bd23ffb03ff4392ee4d263ed4c116cc79b904" gracePeriod=30
Jul 16 17:41:36.939759 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.939730    2577 generic.go:356] "Generic (PLEG): container finished" podID="1a805e47-ee2d-4e88-be11-66f39752357e" containerID="2d4a7b5489058d19da39ff3c989bd23ffb03ff4392ee4d263ed4c116cc79b904" exitCode=0
Jul 16 17:41:36.939935 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.939803    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" event={"ID":"1a805e47-ee2d-4e88-be11-66f39752357e","Type":"ContainerDied","Data":"2d4a7b5489058d19da39ff3c989bd23ffb03ff4392ee4d263ed4c116cc79b904"}
Jul 16 17:41:36.964130 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:36.964101    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:37.061235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061149    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061212    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hljvs\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061235    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061279    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061368    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061407    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061447    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs\") pod \"1a805e47-ee2d-4e88-be11-66f39752357e\" (UID: \"1a805e47-ee2d-4e88-be11-66f39752357e\") "
Jul 16 17:41:37.061743 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061609    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:41:37.061743 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.061703    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-ca-configmap\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.064285 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.064253    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs" (OuterVolumeSpecName: "kube-api-access-hljvs") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "kube-api-access-hljvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:41:37.065113 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.065065    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts" (OuterVolumeSpecName: "cacerts") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:41:37.065416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.065232    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:41:37.065416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.065349    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs" (OuterVolumeSpecName: "local-certs") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:41:37.065416 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.065382    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:41:37.065614 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.065530    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a805e47-ee2d-4e88-be11-66f39752357e" (UID: "1a805e47-ee2d-4e88-be11-66f39752357e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:41:37.162696 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162652    2577 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a805e47-ee2d-4e88-be11-66f39752357e-local-certs\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.162696 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162697    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hljvs\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-kube-api-access-hljvs\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.162926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162713    2577 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a805e47-ee2d-4e88-be11-66f39752357e-istio-token\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.162926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162725    2577 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-cacerts\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.162926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162735    2577 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-kubeconfig\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.162926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.162745    2577 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/1a805e47-ee2d-4e88-be11-66f39752357e-istio-csr-dns-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:41:37.889892 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.889805    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mm9zq"
Jul 16 17:41:37.892461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.892438    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-tvrrq"
Jul 16 17:41:37.947746 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.947719    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"
Jul 16 17:41:37.947901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.947716    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz" event={"ID":"1a805e47-ee2d-4e88-be11-66f39752357e","Type":"ContainerDied","Data":"76ffe247ae86ace1fc6eb1f336c4c82c3123d9f41131919d3b43728de6592d06"}
Jul 16 17:41:37.947901 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.947855    2577 scope.go:117] "RemoveContainer" containerID="2d4a7b5489058d19da39ff3c989bd23ffb03ff4392ee4d263ed4c116cc79b904"
Jul 16 17:41:37.951181 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.950526    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c" event={"ID":"0e4f34dd-7520-4cb8-813c-f8c7f4139170","Type":"ContainerStarted","Data":"4cf235e98107b93e2b4879cdd6ddbd7b662b70ee450e47e89cb5f5f5e7b332b8"}
Jul 16 17:41:37.952069 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.952023    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:41:37.984584 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:37.983177    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c" podStartSLOduration=1.822345508 podStartE2EDuration="4.983157319s" totalImagesPullingTime="3.160811811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:37.98121253 +0000 UTC m=+522.625435448" watchObservedRunningTime="2026-07-16 17:41:37.983157319 +0000 UTC m=+522.627380200"
Jul 16 17:41:38.006382 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:38.006352    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:38.011115 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:38.011089    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-8lfkz"]
Jul 16 17:41:38.507973 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:38.507940    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:38.636750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:38.636699    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:38.782142 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:38.782062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:39.221727 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.221698    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:39.317734 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.317695    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:39.922687 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.922649    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" path="/var/lib/kubelet/pods/1a805e47-ee2d-4e88-be11-66f39752357e/volumes"
Jul 16 17:41:39.964691 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.964657    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf" event={"ID":"7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6","Type":"ContainerStarted","Data":"899c3865b960b604ebfde549552ba421572b742d4bc483e5012d78771f90479f"}
Jul 16 17:41:39.964879 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.964717    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:41:39.999598 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:39.999546    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf" podStartSLOduration=2.8670084449999997 podStartE2EDuration="6.999530746s" totalImagesPullingTime="4.132522301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:41:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:41:39.998338576 +0000 UTC m=+524.642561455" watchObservedRunningTime="2026-07-16 17:41:39.999530746 +0000 UTC m=+524.643753626"
Jul 16 17:41:49.850604 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:49.850518    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:49.952534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:49.952505    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:50.130783 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:50.130755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:50.246562 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:50.246529    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:41:50.980610 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:41:50.980569    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:00.945201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:00.945166    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:01.043076 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:01.043041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:03.078082 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:03.078052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:03.180148 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:03.180117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:08.964163 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:08.964134    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-d7r8c"
Jul 16 17:42:10.971155 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:10.971129    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-kk9hf"
Jul 16 17:42:22.229719 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.229686    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:22.258700 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.258667    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:22.259040 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.259026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery"
Jul 16 17:42:22.259090 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.259042    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery"
Jul 16 17:42:22.259125 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.259098    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a805e47-ee2d-4e88-be11-66f39752357e" containerName="discovery"
Jul 16 17:42:22.261037 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.261016    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:22.263971 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.263947    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 16 17:42:22.265049 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.265027    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zj4xf\""
Jul 16 17:42:22.265142 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.265058    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 16 17:42:22.273637 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.273611    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:22.310128 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.310087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:22.348002 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.347967    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9rcq\" (UniqueName: \"kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq\") pod \"kuadrant-operator-catalog-zpmm7\" (UID: \"34e8cf7a-8be7-4163-9d48-b34a1ade65e0\") " pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:22.410155 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.410116    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:22.449131 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.449093    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9rcq\" (UniqueName: \"kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq\") pod \"kuadrant-operator-catalog-zpmm7\" (UID: \"34e8cf7a-8be7-4163-9d48-b34a1ade65e0\") " pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:22.464579 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.464545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9rcq\" (UniqueName: \"kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq\") pod \"kuadrant-operator-catalog-zpmm7\" (UID: \"34e8cf7a-8be7-4163-9d48-b34a1ade65e0\") " pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:22.572840 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.572749    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:22.621926 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.621897    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:22.720335 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.720308    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:22.722935 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:22.722897    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34e8cf7a_8be7_4163_9d48_b34a1ade65e0.slice/crio-b6f832c4d6dfab052904b8fa2296bc54b28df97b73e2da9dfa4eabe67e6c9a05 WatchSource:0}: Error finding container b6f832c4d6dfab052904b8fa2296bc54b28df97b73e2da9dfa4eabe67e6c9a05: Status 404 returned error can't find the container with id b6f832c4d6dfab052904b8fa2296bc54b28df97b73e2da9dfa4eabe67e6c9a05
Jul 16 17:42:22.834860 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.834782    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6t2n2"]
Jul 16 17:42:22.837511 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.837494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:22.862131 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.862106    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6t2n2"]
Jul 16 17:42:22.952785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:22.952751    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vwf\" (UniqueName: \"kubernetes.io/projected/aa38f825-2638-4593-8ca3-ca3d02700a42-kube-api-access-z4vwf\") pod \"kuadrant-operator-catalog-6t2n2\" (UID: \"aa38f825-2638-4593-8ca3-ca3d02700a42\") " pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:23.053665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:23.053633    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vwf\" (UniqueName: \"kubernetes.io/projected/aa38f825-2638-4593-8ca3-ca3d02700a42-kube-api-access-z4vwf\") pod \"kuadrant-operator-catalog-6t2n2\" (UID: \"aa38f825-2638-4593-8ca3-ca3d02700a42\") " pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:23.067419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:23.067387    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vwf\" (UniqueName: \"kubernetes.io/projected/aa38f825-2638-4593-8ca3-ca3d02700a42-kube-api-access-z4vwf\") pod \"kuadrant-operator-catalog-6t2n2\" (UID: \"aa38f825-2638-4593-8ca3-ca3d02700a42\") " pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:23.146312 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:23.146263    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:23.164631 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:23.164604    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7" event={"ID":"34e8cf7a-8be7-4163-9d48-b34a1ade65e0","Type":"ContainerStarted","Data":"b6f832c4d6dfab052904b8fa2296bc54b28df97b73e2da9dfa4eabe67e6c9a05"}
Jul 16 17:42:23.281025 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:23.281003    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-6t2n2"]
Jul 16 17:42:23.282924 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:23.282891    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa38f825_2638_4593_8ca3_ca3d02700a42.slice/crio-49560c7126d671c52f1b48bd7995ac6e4e698d5aaac141540d97e5ebaf60bb88 WatchSource:0}: Error finding container 49560c7126d671c52f1b48bd7995ac6e4e698d5aaac141540d97e5ebaf60bb88: Status 404 returned error can't find the container with id 49560c7126d671c52f1b48bd7995ac6e4e698d5aaac141540d97e5ebaf60bb88
Jul 16 17:42:24.170985 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:24.170955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2" event={"ID":"aa38f825-2638-4593-8ca3-ca3d02700a42","Type":"ContainerStarted","Data":"49560c7126d671c52f1b48bd7995ac6e4e698d5aaac141540d97e5ebaf60bb88"}
Jul 16 17:42:25.177025 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.176993    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2" event={"ID":"aa38f825-2638-4593-8ca3-ca3d02700a42","Type":"ContainerStarted","Data":"1bfa169ecb65ba9472d7083882f3964d8f5a4ec3333368d16ac6558f2566bd6e"}
Jul 16 17:42:25.178534 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.178511    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7" event={"ID":"34e8cf7a-8be7-4163-9d48-b34a1ade65e0","Type":"ContainerStarted","Data":"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"}
Jul 16 17:42:25.178644 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.178572    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7" podUID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" containerName="registry-server" containerID="cri-o://b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c" gracePeriod=2
Jul 16 17:42:25.200710 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.200647    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2" podStartSLOduration=1.868183922 podStartE2EDuration="3.200628148s" totalImagesPullingTime="1.332444226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:42:25.198868723 +0000 UTC m=+569.843091602" watchObservedRunningTime="2026-07-16 17:42:25.200628148 +0000 UTC m=+569.844851028"
Jul 16 17:42:25.428327 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.428254    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:25.575586 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.575551    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9rcq\" (UniqueName: \"kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq\") pod \"34e8cf7a-8be7-4163-9d48-b34a1ade65e0\" (UID: \"34e8cf7a-8be7-4163-9d48-b34a1ade65e0\") "
Jul 16 17:42:25.577670 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.577637    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq" (OuterVolumeSpecName: "kube-api-access-l9rcq") pod "34e8cf7a-8be7-4163-9d48-b34a1ade65e0" (UID: "34e8cf7a-8be7-4163-9d48-b34a1ade65e0"). InnerVolumeSpecName "kube-api-access-l9rcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:42:25.677115 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:25.677085    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9rcq\" (UniqueName: \"kubernetes.io/projected/34e8cf7a-8be7-4163-9d48-b34a1ade65e0-kube-api-access-l9rcq\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:26.184995 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.184904    2577 generic.go:356] "Generic (PLEG): container finished" podID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" containerID="b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c" exitCode=0
Jul 16 17:42:26.184995 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.184952    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7"
Jul 16 17:42:26.185518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.184991    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7" event={"ID":"34e8cf7a-8be7-4163-9d48-b34a1ade65e0","Type":"ContainerDied","Data":"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"}
Jul 16 17:42:26.185518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.185035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zpmm7" event={"ID":"34e8cf7a-8be7-4163-9d48-b34a1ade65e0","Type":"ContainerDied","Data":"b6f832c4d6dfab052904b8fa2296bc54b28df97b73e2da9dfa4eabe67e6c9a05"}
Jul 16 17:42:26.185518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.185055    2577 scope.go:117] "RemoveContainer" containerID="b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"
Jul 16 17:42:26.193929 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.193907    2577 scope.go:117] "RemoveContainer" containerID="b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"
Jul 16 17:42:26.194209 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:42:26.194188    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c\": container with ID starting with b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c not found: ID does not exist" containerID="b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"
Jul 16 17:42:26.194259 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.194218    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c"} err="failed to get container status \"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c\": rpc error: code = NotFound desc = could not find container \"b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c\": container with ID starting with b915a792ef901f4352b1e5f24a527bd10a026433369f2681266155272ae7b64c not found: ID does not exist"
Jul 16 17:42:26.203957 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.203932    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:26.210046 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:26.210027    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zpmm7"]
Jul 16 17:42:27.922399 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:27.922371    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" path="/var/lib/kubelet/pods/34e8cf7a-8be7-4163-9d48-b34a1ade65e0/volumes"
Jul 16 17:42:33.147041 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:33.147002    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:33.147530 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:33.147069    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:33.169588 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:33.169565    2577 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:33.238495 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:33.238471    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-6t2n2"
Jul 16 17:42:37.662087 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.662052    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"]
Jul 16 17:42:37.662502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.662406    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" containerName="registry-server"
Jul 16 17:42:37.662502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.662417    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" containerName="registry-server"
Jul 16 17:42:37.662502 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.662477    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="34e8cf7a-8be7-4163-9d48-b34a1ade65e0" containerName="registry-server"
Jul 16 17:42:37.665219 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.665200    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.667711 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.667689    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rbdx7\""
Jul 16 17:42:37.674613 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.674591    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"]
Jul 16 17:42:37.782914 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.782882    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.783065 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.782939    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8snch\" (UniqueName: \"kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.783065 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.782993    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.884216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.884170    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.884407 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.884326    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.884407 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.884381    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8snch\" (UniqueName: \"kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.884675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.884649    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.884753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.884660    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.894539 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.894515    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8snch\" (UniqueName: \"kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:37.974579 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:37.974488    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:38.062669 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.062629    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"]
Jul 16 17:42:38.065836 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.065815    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.075992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.075924    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"]
Jul 16 17:42:38.108722 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.108689    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"]
Jul 16 17:42:38.111869 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:38.111836    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12efee3d_269a_427f_b12b_7268659078bb.slice/crio-0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845 WatchSource:0}: Error finding container 0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845: Status 404 returned error can't find the container with id 0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845
Jul 16 17:42:38.185857 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.185815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8t8j\" (UniqueName: \"kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.186057 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.185874    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.186057 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.185920    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.240182 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.240102    2577 generic.go:356] "Generic (PLEG): container finished" podID="12efee3d-269a-427f-b12b-7268659078bb" containerID="0a67902a7f0f29164ce4bb9154e1f4b560f94729d487b4def1cbee7ca9a78a06" exitCode=0
Jul 16 17:42:38.240320 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.240181    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerDied","Data":"0a67902a7f0f29164ce4bb9154e1f4b560f94729d487b4def1cbee7ca9a78a06"}
Jul 16 17:42:38.240320 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.240232    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerStarted","Data":"0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845"}
Jul 16 17:42:38.286716 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.286679    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8t8j\" (UniqueName: \"kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.286892 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.286721    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.286892 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.286756    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.287137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.287109    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.287417 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.287133    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.297310 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.297262    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8t8j\" (UniqueName: \"kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.376899 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.376865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:38.462965 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.462936    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"]
Jul 16 17:42:38.466618 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.466594    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.475988 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.475897    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"]
Jul 16 17:42:38.508554 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.508535    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"]
Jul 16 17:42:38.510782 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:38.510754    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda511b5e_1f60_4f73_b41f_814ea6d94ed8.slice/crio-cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c WatchSource:0}: Error finding container cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c: Status 404 returned error can't find the container with id cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c
Jul 16 17:42:38.588930 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.588895    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.589065 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.588934    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.589065 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.589004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8d9s\" (UniqueName: \"kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.689406 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.689371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.689784 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.689428    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8d9s\" (UniqueName: \"kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.689784 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.689487    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.689856 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.689832    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.689856 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.689850    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.699640 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.699612    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8d9s\" (UniqueName: \"kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.779424 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.779344    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:38.869008 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.868976    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"]
Jul 16 17:42:38.872175 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.872156    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:38.882372 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.882348    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"]
Jul 16 17:42:38.910776 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.910755    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"]
Jul 16 17:42:38.913078 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:38.913050    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dd67ad_ec37_4e93_bdb9_f4bcc19dc2a5.slice/crio-714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4 WatchSource:0}: Error finding container 714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4: Status 404 returned error can't find the container with id 714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4
Jul 16 17:42:38.991894 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.991870    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tm58\" (UniqueName: \"kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:38.992014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.991905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:38.992014 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:38.991943    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.093113 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.093022    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.093267 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.093179    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tm58\" (UniqueName: \"kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.093475 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.093434    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.093596 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.093526    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.094015 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.093988    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.104268 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.104244    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tm58\" (UniqueName: \"kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.182524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.182499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:39.250598 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.250562    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerStarted","Data":"aca16f524b5f30d22c1df255a591a57eb6b57a0c8251c56f665a26ed5826de31"}
Jul 16 17:42:39.252207 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.252177    2577 generic.go:356] "Generic (PLEG): container finished" podID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerID="d40b7038b2b2a54e96cfd5451d25b887843414b8b4c063fbd3c60ca485ce5e21" exitCode=0
Jul 16 17:42:39.252350 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.252243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4" event={"ID":"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5","Type":"ContainerDied","Data":"d40b7038b2b2a54e96cfd5451d25b887843414b8b4c063fbd3c60ca485ce5e21"}
Jul 16 17:42:39.252350 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.252283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4" event={"ID":"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5","Type":"ContainerStarted","Data":"714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4"}
Jul 16 17:42:39.254132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.254081    2577 generic.go:356] "Generic (PLEG): container finished" podID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerID="81341d0ef4c6e265e9f7bbe3a6c815a7e159a24a6bb3f82f86a5a0a8150049c1" exitCode=0
Jul 16 17:42:39.254406 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.254129    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74" event={"ID":"da511b5e-1f60-4f73-b41f-814ea6d94ed8","Type":"ContainerDied","Data":"81341d0ef4c6e265e9f7bbe3a6c815a7e159a24a6bb3f82f86a5a0a8150049c1"}
Jul 16 17:42:39.254406 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.254165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74" event={"ID":"da511b5e-1f60-4f73-b41f-814ea6d94ed8","Type":"ContainerStarted","Data":"cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c"}
Jul 16 17:42:39.327958 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:39.327930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"]
Jul 16 17:42:39.330493 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:39.330467    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0936526b_4e88_465b_b125_88016f58d87c.slice/crio-4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff WatchSource:0}: Error finding container 4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff: Status 404 returned error can't find the container with id 4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff
Jul 16 17:42:40.260082 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.260039    2577 generic.go:356] "Generic (PLEG): container finished" podID="12efee3d-269a-427f-b12b-7268659078bb" containerID="aca16f524b5f30d22c1df255a591a57eb6b57a0c8251c56f665a26ed5826de31" exitCode=0
Jul 16 17:42:40.260540 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.260127    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerDied","Data":"aca16f524b5f30d22c1df255a591a57eb6b57a0c8251c56f665a26ed5826de31"}
Jul 16 17:42:40.261654 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.261628    2577 generic.go:356] "Generic (PLEG): container finished" podID="0936526b-4e88-465b-b125-88016f58d87c" containerID="e88b728d85102ec8112e7f7d82289a370d2a052a8048848c8475e9ed43038c81" exitCode=0
Jul 16 17:42:40.261775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.261660    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66" event={"ID":"0936526b-4e88-465b-b125-88016f58d87c","Type":"ContainerDied","Data":"e88b728d85102ec8112e7f7d82289a370d2a052a8048848c8475e9ed43038c81"}
Jul 16 17:42:40.261775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.261699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66" event={"ID":"0936526b-4e88-465b-b125-88016f58d87c","Type":"ContainerStarted","Data":"4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff"}
Jul 16 17:42:40.263791 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.263766    2577 generic.go:356] "Generic (PLEG): container finished" podID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerID="6cb11ab7c9824af6404d174b281a97036ab16fae1a4f593adf044864363a03ca" exitCode=0
Jul 16 17:42:40.263915 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.263806    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4" event={"ID":"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5","Type":"ContainerDied","Data":"6cb11ab7c9824af6404d174b281a97036ab16fae1a4f593adf044864363a03ca"}
Jul 16 17:42:40.266343 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.266318    2577 generic.go:356] "Generic (PLEG): container finished" podID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerID="8e92a9b3ac3c99943b9a07f0856b0292dc9e9ae20aae9e8e71c3079954883623" exitCode=0
Jul 16 17:42:40.266442 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:40.266405    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74" event={"ID":"da511b5e-1f60-4f73-b41f-814ea6d94ed8","Type":"ContainerDied","Data":"8e92a9b3ac3c99943b9a07f0856b0292dc9e9ae20aae9e8e71c3079954883623"}
Jul 16 17:42:41.274863 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.274832    2577 generic.go:356] "Generic (PLEG): container finished" podID="12efee3d-269a-427f-b12b-7268659078bb" containerID="14b961b703a710296766f47e39ad1875072a57cbabd0b708aa5acd0b55cd3bb0" exitCode=0
Jul 16 17:42:41.275329 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.274919    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerDied","Data":"14b961b703a710296766f47e39ad1875072a57cbabd0b708aa5acd0b55cd3bb0"}
Jul 16 17:42:41.277020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.276995    2577 generic.go:356] "Generic (PLEG): container finished" podID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerID="c6ba7146ddeaecdd0423774bbfd97ea7f22ed7243a5a81e80bf5cc0b3562dc8b" exitCode=0
Jul 16 17:42:41.277150 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.277075    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4" event={"ID":"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5","Type":"ContainerDied","Data":"c6ba7146ddeaecdd0423774bbfd97ea7f22ed7243a5a81e80bf5cc0b3562dc8b"}
Jul 16 17:42:41.278849 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.278828    2577 generic.go:356] "Generic (PLEG): container finished" podID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerID="47fe85e6a7d7e5d6b1b0572021bf2e5930ea4c0ed8393728ad2baf8d08f5cd4e" exitCode=0
Jul 16 17:42:41.278954 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:41.278891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74" event={"ID":"da511b5e-1f60-4f73-b41f-814ea6d94ed8","Type":"ContainerDied","Data":"47fe85e6a7d7e5d6b1b0572021bf2e5930ea4c0ed8393728ad2baf8d08f5cd4e"}
Jul 16 17:42:42.285362 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.285328    2577 generic.go:356] "Generic (PLEG): container finished" podID="0936526b-4e88-465b-b125-88016f58d87c" containerID="fc5d091bfdae7be627b16e2345cee3df55309d30da9f9bac1b5764ed89c968b2" exitCode=0
Jul 16 17:42:42.285775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.285399    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66" event={"ID":"0936526b-4e88-465b-b125-88016f58d87c","Type":"ContainerDied","Data":"fc5d091bfdae7be627b16e2345cee3df55309d30da9f9bac1b5764ed89c968b2"}
Jul 16 17:42:42.455990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.455961    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:42.539825 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.539765    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:42.542699 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.542678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:42.626278 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626251    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle\") pod \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") "
Jul 16 17:42:42.626455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626334    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle\") pod \"12efee3d-269a-427f-b12b-7268659078bb\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") "
Jul 16 17:42:42.626455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626356    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8snch\" (UniqueName: \"kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch\") pod \"12efee3d-269a-427f-b12b-7268659078bb\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") "
Jul 16 17:42:42.626455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626377    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8t8j\" (UniqueName: \"kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j\") pod \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") "
Jul 16 17:42:42.626455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626436    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util\") pod \"12efee3d-269a-427f-b12b-7268659078bb\" (UID: \"12efee3d-269a-427f-b12b-7268659078bb\") "
Jul 16 17:42:42.626628 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626457    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util\") pod \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\" (UID: \"da511b5e-1f60-4f73-b41f-814ea6d94ed8\") "
Jul 16 17:42:42.627077 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.626870    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle" (OuterVolumeSpecName: "bundle") pod "da511b5e-1f60-4f73-b41f-814ea6d94ed8" (UID: "da511b5e-1f60-4f73-b41f-814ea6d94ed8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.627191 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.627084    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle" (OuterVolumeSpecName: "bundle") pod "12efee3d-269a-427f-b12b-7268659078bb" (UID: "12efee3d-269a-427f-b12b-7268659078bb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.628549 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.628526    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j" (OuterVolumeSpecName: "kube-api-access-b8t8j") pod "da511b5e-1f60-4f73-b41f-814ea6d94ed8" (UID: "da511b5e-1f60-4f73-b41f-814ea6d94ed8"). InnerVolumeSpecName "kube-api-access-b8t8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:42:42.628795 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.628781    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch" (OuterVolumeSpecName: "kube-api-access-8snch") pod "12efee3d-269a-427f-b12b-7268659078bb" (UID: "12efee3d-269a-427f-b12b-7268659078bb"). InnerVolumeSpecName "kube-api-access-8snch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:42:42.631730 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.631696    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util" (OuterVolumeSpecName: "util") pod "12efee3d-269a-427f-b12b-7268659078bb" (UID: "12efee3d-269a-427f-b12b-7268659078bb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.632914 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.632894    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util" (OuterVolumeSpecName: "util") pod "da511b5e-1f60-4f73-b41f-814ea6d94ed8" (UID: "da511b5e-1f60-4f73-b41f-814ea6d94ed8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.728038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728007    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util\") pod \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") "
Jul 16 17:42:42.728216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728088    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle\") pod \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") "
Jul 16 17:42:42.728216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8d9s\" (UniqueName: \"kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s\") pod \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\" (UID: \"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5\") "
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728266    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728279    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728307    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da511b5e-1f60-4f73-b41f-814ea6d94ed8-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728318    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/12efee3d-269a-427f-b12b-7268659078bb-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728332    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8snch\" (UniqueName: \"kubernetes.io/projected/12efee3d-269a-427f-b12b-7268659078bb-kube-api-access-8snch\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728341    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8t8j\" (UniqueName: \"kubernetes.io/projected/da511b5e-1f60-4f73-b41f-814ea6d94ed8-kube-api-access-b8t8j\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.728664 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.728534    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle" (OuterVolumeSpecName: "bundle") pod "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" (UID: "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.730137 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.730117    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s" (OuterVolumeSpecName: "kube-api-access-v8d9s") pod "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" (UID: "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5"). InnerVolumeSpecName "kube-api-access-v8d9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:42:42.733480 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.733457    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util" (OuterVolumeSpecName: "util") pod "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" (UID: "54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:42.829318 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.829207    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.829318 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.829237    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8d9s\" (UniqueName: \"kubernetes.io/projected/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-kube-api-access-v8d9s\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:42.829318 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:42.829246    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:43.296190 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.296152    2577 generic.go:356] "Generic (PLEG): container finished" podID="0936526b-4e88-465b-b125-88016f58d87c" containerID="60656ea4949ceedd57f4689b3c1119bcd8cf37fe0b1587482b8f8f90f3d1636b" exitCode=0
Jul 16 17:42:43.296633 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.296231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66" event={"ID":"0936526b-4e88-465b-b125-88016f58d87c","Type":"ContainerDied","Data":"60656ea4949ceedd57f4689b3c1119bcd8cf37fe0b1587482b8f8f90f3d1636b"}
Jul 16 17:42:43.298080 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.298046    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4" event={"ID":"54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5","Type":"ContainerDied","Data":"714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4"}
Jul 16 17:42:43.298223 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.298088    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="714da196894365b02987234274d396e72b2dd72d4e4909c8b2fc9cd17a2909c4"
Jul 16 17:42:43.298223 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.298094    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4"
Jul 16 17:42:43.299959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.299938    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74"
Jul 16 17:42:43.299959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.299953    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74" event={"ID":"da511b5e-1f60-4f73-b41f-814ea6d94ed8","Type":"ContainerDied","Data":"cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c"}
Jul 16 17:42:43.300140 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.299987    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb44f832e20bee9fbbbde458f1c126eb8b12112174a5a8130d9541c98ea7807c"
Jul 16 17:42:43.302197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.302168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7" event={"ID":"12efee3d-269a-427f-b12b-7268659078bb","Type":"ContainerDied","Data":"0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845"}
Jul 16 17:42:43.302316 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.302207    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0c3c4ea5e4b980be65c0a760b7075f41b996fe9c2840727c2d212726ba1b7845"
Jul 16 17:42:43.302316 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:43.302237    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7"
Jul 16 17:42:44.438651 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.438626    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:44.543754 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.543719    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tm58\" (UniqueName: \"kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58\") pod \"0936526b-4e88-465b-b125-88016f58d87c\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") "
Jul 16 17:42:44.543916 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.543776    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle\") pod \"0936526b-4e88-465b-b125-88016f58d87c\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") "
Jul 16 17:42:44.543916 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.543793    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util\") pod \"0936526b-4e88-465b-b125-88016f58d87c\" (UID: \"0936526b-4e88-465b-b125-88016f58d87c\") "
Jul 16 17:42:44.544412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.544379    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle" (OuterVolumeSpecName: "bundle") pod "0936526b-4e88-465b-b125-88016f58d87c" (UID: "0936526b-4e88-465b-b125-88016f58d87c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:44.545789 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.545764    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58" (OuterVolumeSpecName: "kube-api-access-2tm58") pod "0936526b-4e88-465b-b125-88016f58d87c" (UID: "0936526b-4e88-465b-b125-88016f58d87c"). InnerVolumeSpecName "kube-api-access-2tm58". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:42:44.548825 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.548804    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util" (OuterVolumeSpecName: "util") pod "0936526b-4e88-465b-b125-88016f58d87c" (UID: "0936526b-4e88-465b-b125-88016f58d87c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:42:44.645245 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.645206    2577 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-bundle\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:44.645245 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.645242    2577 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0936526b-4e88-465b-b125-88016f58d87c-util\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:44.645245 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:44.645252    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tm58\" (UniqueName: \"kubernetes.io/projected/0936526b-4e88-465b-b125-88016f58d87c-kube-api-access-2tm58\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:42:45.314706 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:45.314678    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66"
Jul 16 17:42:45.314888 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:45.314675    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66" event={"ID":"0936526b-4e88-465b-b125-88016f58d87c","Type":"ContainerDied","Data":"4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff"}
Jul 16 17:42:45.314888 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:45.314802    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bb5302451f5278785cd294e0988bf4732d07cb3719fcfd57ed81ca635da02ff"
Jul 16 17:42:50.497928 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:50.497888    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:54.009925 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:54.009886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:55.352625 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352594    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"]
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352921    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="extract"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352932    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="extract"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352944    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="pull"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352950    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="pull"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352961    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="util"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352967    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="util"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352972    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="util"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352977    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="util"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352984    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="pull"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352989    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="pull"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352994    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="extract"
Jul 16 17:42:55.352992 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.352999    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353013    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="pull"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353018    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="pull"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353025    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="util"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353029    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="util"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353035    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353039    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353046    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="util"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353050    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="util"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353056    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353060    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353065    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="pull"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353070    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="pull"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353124    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="da511b5e-1f60-4f73-b41f-814ea6d94ed8" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353133    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="12efee3d-269a-427f-b12b-7268659078bb" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353139    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="0936526b-4e88-465b-b125-88016f58d87c" containerName="extract"
Jul 16 17:42:55.353384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.353145    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5" containerName="extract"
Jul 16 17:42:55.359438 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.359420    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.365138 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.365118    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s86mb\""
Jul 16 17:42:55.374831 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.374809    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"]
Jul 16 17:42:55.440476 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.440448    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.440603 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.440508    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rc9ns\" (UniqueName: \"kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.529873 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.529838    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:55.541369 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.541346    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.541439 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.541397    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rc9ns\" (UniqueName: \"kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.541700 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.541683    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.552332 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.552310    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rc9ns\" (UniqueName: \"kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns\") pod \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.669453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.669422    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:42:55.790496 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.790469    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:42:55.794418 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.794397    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:42:55.796200 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.796180    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:42:55.798664 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.798642    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:42:55.839088 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.839059    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"]
Jul 16 17:42:55.839995 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:55.839950    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f2b7025_94e8_40b6_84f5_9045c0641f52.slice/crio-cb1a1b5611ccb197d9499f5d9768fd90f7e7ec69d0f4cec07e8e4720632139ea WatchSource:0}: Error finding container cb1a1b5611ccb197d9499f5d9768fd90f7e7ec69d0f4cec07e8e4720632139ea: Status 404 returned error can't find the container with id cb1a1b5611ccb197d9499f5d9768fd90f7e7ec69d0f4cec07e8e4720632139ea
Jul 16 17:42:55.943896 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:55.943807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:56.369283 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:56.369253    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8" event={"ID":"5f2b7025-94e8-40b6-84f5-9045c0641f52","Type":"ContainerStarted","Data":"cb1a1b5611ccb197d9499f5d9768fd90f7e7ec69d0f4cec07e8e4720632139ea"}
Jul 16 17:42:56.930838 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:56.930807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:57.034937 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.034905    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:57.845049 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.844929    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"]
Jul 16 17:42:57.873419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.849360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:42:57.873419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.853403    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-l6flb\""
Jul 16 17:42:57.873419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.860748    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"]
Jul 16 17:42:57.964462 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:57.964427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6bkf\" (UniqueName: \"kubernetes.io/projected/d2552b95-731a-4c83-b2fc-b51faed2e237-kube-api-access-c6bkf\") pod \"authorino-operator-75cc8d5cb7-2ngr8\" (UID: \"d2552b95-731a-4c83-b2fc-b51faed2e237\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:42:58.065122 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.065078    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6bkf\" (UniqueName: \"kubernetes.io/projected/d2552b95-731a-4c83-b2fc-b51faed2e237-kube-api-access-c6bkf\") pod \"authorino-operator-75cc8d5cb7-2ngr8\" (UID: \"d2552b95-731a-4c83-b2fc-b51faed2e237\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:42:58.078432 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.078398    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6bkf\" (UniqueName: \"kubernetes.io/projected/d2552b95-731a-4c83-b2fc-b51faed2e237-kube-api-access-c6bkf\") pod \"authorino-operator-75cc8d5cb7-2ngr8\" (UID: \"d2552b95-731a-4c83-b2fc-b51faed2e237\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:42:58.162358 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.162306    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:42:58.313379 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.313303    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"]
Jul 16 17:42:58.315675 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:42:58.315649    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2552b95_731a_4c83_b2fc_b51faed2e237.slice/crio-a765133123b98380b133f84d4f3c0ad73776e894905cb37b60dc690d2c29432c WatchSource:0}: Error finding container a765133123b98380b133f84d4f3c0ad73776e894905cb37b60dc690d2c29432c: Status 404 returned error can't find the container with id a765133123b98380b133f84d4f3c0ad73776e894905cb37b60dc690d2c29432c
Jul 16 17:42:58.379491 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.379459    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8" event={"ID":"d2552b95-731a-4c83-b2fc-b51faed2e237","Type":"ContainerStarted","Data":"a765133123b98380b133f84d4f3c0ad73776e894905cb37b60dc690d2c29432c"}
Jul 16 17:42:58.529134 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.529054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:42:58.628455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:42:58.628414    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:00.046392 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.046357    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"]
Jul 16 17:43:00.056182 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.056157    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:00.059067 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.059047    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 16 17:43:00.059285 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.059272    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-52679\""
Jul 16 17:43:00.063951 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.063929    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"]
Jul 16 17:43:00.186412 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.186375    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9clnd\" (UniqueName: \"kubernetes.io/projected/ddc40b80-61db-45ae-89fe-107e59e01993-kube-api-access-9clnd\") pod \"dns-operator-controller-manager-864dd78c4c-zmg4h\" (UID: \"ddc40b80-61db-45ae-89fe-107e59e01993\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:00.287826 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.287786    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9clnd\" (UniqueName: \"kubernetes.io/projected/ddc40b80-61db-45ae-89fe-107e59e01993-kube-api-access-9clnd\") pod \"dns-operator-controller-manager-864dd78c4c-zmg4h\" (UID: \"ddc40b80-61db-45ae-89fe-107e59e01993\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:00.300658 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.300580    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9clnd\" (UniqueName: \"kubernetes.io/projected/ddc40b80-61db-45ae-89fe-107e59e01993-kube-api-access-9clnd\") pod \"dns-operator-controller-manager-864dd78c4c-zmg4h\" (UID: \"ddc40b80-61db-45ae-89fe-107e59e01993\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:00.370440 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.370410    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:00.700170 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:00.700063    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:01.974304 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:01.974266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"]
Jul 16 17:43:01.976061 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:01.976036    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc40b80_61db_45ae_89fe_107e59e01993.slice/crio-0477bcb37b57519cb6b2ce7443ca93304f8102c64b2c681da9d9bf4829f0020e WatchSource:0}: Error finding container 0477bcb37b57519cb6b2ce7443ca93304f8102c64b2c681da9d9bf4829f0020e: Status 404 returned error can't find the container with id 0477bcb37b57519cb6b2ce7443ca93304f8102c64b2c681da9d9bf4829f0020e
Jul 16 17:43:02.266198 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.266157    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"]
Jul 16 17:43:02.269878 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.269862    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:02.272634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.272616    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-xjvnx\""
Jul 16 17:43:02.281019 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.280996    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"]
Jul 16 17:43:02.406894 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.406861    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r759l\" (UniqueName: \"kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l\") pod \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" (UID: \"aaf9bc95-32fb-4426-b319-ba765b5b35a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:02.410126 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.410091    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h" event={"ID":"ddc40b80-61db-45ae-89fe-107e59e01993","Type":"ContainerStarted","Data":"0477bcb37b57519cb6b2ce7443ca93304f8102c64b2c681da9d9bf4829f0020e"}
Jul 16 17:43:02.411665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.411634    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8" event={"ID":"5f2b7025-94e8-40b6-84f5-9045c0641f52","Type":"ContainerStarted","Data":"dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4"}
Jul 16 17:43:02.411797 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.411754    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:02.413019 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.412999    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8" event={"ID":"d2552b95-731a-4c83-b2fc-b51faed2e237","Type":"ContainerStarted","Data":"50a59617bb51fb762de6b5ddb97b00639bcf8bd94bdbc028aadc3ccb37f1893a"}
Jul 16 17:43:02.413107 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.413056    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:43:02.438850 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.438791    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8" podStartSLOduration=1.445801103 podStartE2EDuration="7.438770868s" totalImagesPullingTime="5.992969765s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:02.437352383 +0000 UTC m=+607.081575261" watchObservedRunningTime="2026-07-16 17:43:02.438770868 +0000 UTC m=+607.082993751"
Jul 16 17:43:02.457833 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.457789    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8" podStartSLOduration=1.952421777 podStartE2EDuration="5.457776852s" totalImagesPullingTime="3.505355075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:42:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:02.455823838 +0000 UTC m=+607.100046716" watchObservedRunningTime="2026-07-16 17:43:02.457776852 +0000 UTC m=+607.101999730"
Jul 16 17:43:02.507581 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.507549    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r759l\" (UniqueName: \"kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l\") pod \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" (UID: \"aaf9bc95-32fb-4426-b319-ba765b5b35a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:02.519340 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.519239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r759l\" (UniqueName: \"kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l\") pod \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" (UID: \"aaf9bc95-32fb-4426-b319-ba765b5b35a2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:02.535643 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.535615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:02.581008 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.580977    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:02.723080 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:02.723056    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"]
Jul 16 17:43:02.724874 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:02.724850    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaf9bc95_32fb_4426_b319_ba765b5b35a2.slice/crio-ab74b7019d04f45228246b8dcbe86ae49839dd0b769813336ecbb3bb86ab8d55 WatchSource:0}: Error finding container ab74b7019d04f45228246b8dcbe86ae49839dd0b769813336ecbb3bb86ab8d55: Status 404 returned error can't find the container with id ab74b7019d04f45228246b8dcbe86ae49839dd0b769813336ecbb3bb86ab8d55
Jul 16 17:43:03.419667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:03.419629    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4" event={"ID":"aaf9bc95-32fb-4426-b319-ba765b5b35a2","Type":"ContainerStarted","Data":"ab74b7019d04f45228246b8dcbe86ae49839dd0b769813336ecbb3bb86ab8d55"}
Jul 16 17:43:04.312707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.312670    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:04.413975 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.413896    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:04.975247 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.975168    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"]
Jul 16 17:43:04.979058 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.979030    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:04.981733 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.981660    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 16 17:43:04.981733 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.981680    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 16 17:43:04.981948 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.981750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rbdx7\""
Jul 16 17:43:04.991703 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.989964    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"]
Jul 16 17:43:04.997314 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:04.997265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:05.031851 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.031815    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.032041 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.032021    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1756b7b7-96d1-4789-b42e-5e270b1855ba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.032114 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.032080    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9dp7\" (UniqueName: \"kubernetes.io/projected/1756b7b7-96d1-4789-b42e-5e270b1855ba-kube-api-access-d9dp7\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.133671 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.133616    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.133863 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.133764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1756b7b7-96d1-4789-b42e-5e270b1855ba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.133863 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:05.133796    2577 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 16 17:43:05.133979 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:05.133873    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert podName:1756b7b7-96d1-4789-b42e-5e270b1855ba nodeName:}" failed. No retries permitted until 2026-07-16 17:43:05.633850733 +0000 UTC m=+610.278073593 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-262zh" (UID: "1756b7b7-96d1-4789-b42e-5e270b1855ba") : secret "plugin-serving-cert" not found
Jul 16 17:43:05.133979 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.133802    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9dp7\" (UniqueName: \"kubernetes.io/projected/1756b7b7-96d1-4789-b42e-5e270b1855ba-kube-api-access-d9dp7\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.134564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.134540    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1756b7b7-96d1-4789-b42e-5e270b1855ba-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.143700 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.143672    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9dp7\" (UniqueName: \"kubernetes.io/projected/1756b7b7-96d1-4789-b42e-5e270b1855ba-kube-api-access-d9dp7\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.434753 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.434713    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4" event={"ID":"aaf9bc95-32fb-4426-b319-ba765b5b35a2","Type":"ContainerStarted","Data":"ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65"}
Jul 16 17:43:05.434937 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.434817    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:05.436263 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.436239    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h" event={"ID":"ddc40b80-61db-45ae-89fe-107e59e01993","Type":"ContainerStarted","Data":"40111d57f18c4ca49d57f1962227d30c59ba213ef735197c1633f0233a425629"}
Jul 16 17:43:05.436441 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.436420    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:05.478202 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.478100    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4" podStartSLOduration=1.556230771 podStartE2EDuration="3.478084088s" totalImagesPullingTime="1.921853317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:05.47571957 +0000 UTC m=+610.119942472" watchObservedRunningTime="2026-07-16 17:43:05.478084088 +0000 UTC m=+610.122306966"
Jul 16 17:43:05.497035 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.496988    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h" podStartSLOduration=2.254664317 podStartE2EDuration="5.49697131s" totalImagesPullingTime="3.242306993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:05.494535258 +0000 UTC m=+610.138758139" watchObservedRunningTime="2026-07-16 17:43:05.49697131 +0000 UTC m=+610.141194189"
Jul 16 17:43:05.522136 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.522107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:05.638250 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.638218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.640785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.640758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1756b7b7-96d1-4789-b42e-5e270b1855ba-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-262zh\" (UID: \"1756b7b7-96d1-4789-b42e-5e270b1855ba\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:05.892262 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:05.892228    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"
Jul 16 17:43:06.048125 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:06.048092    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-262zh"]
Jul 16 17:43:06.054837 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:06.054812    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1756b7b7_96d1_4789_b42e_5e270b1855ba.slice/crio-d3d31d70523f0dcfe9e535302c67a3e6ae09fa56a13c57b35d6e0cd3e94f045a WatchSource:0}: Error finding container d3d31d70523f0dcfe9e535302c67a3e6ae09fa56a13c57b35d6e0cd3e94f045a: Status 404 returned error can't find the container with id d3d31d70523f0dcfe9e535302c67a3e6ae09fa56a13c57b35d6e0cd3e94f045a
Jul 16 17:43:06.443033 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:06.442998    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh" event={"ID":"1756b7b7-96d1-4789-b42e-5e270b1855ba","Type":"ContainerStarted","Data":"d3d31d70523f0dcfe9e535302c67a3e6ae09fa56a13c57b35d6e0cd3e94f045a"}
Jul 16 17:43:13.422895 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:13.422836    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2ngr8"
Jul 16 17:43:13.423476 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:13.423118    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:13.586194 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:13.586148    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:13.706885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:13.706771    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:15.422781 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.422750    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"]
Jul 16 17:43:15.423233 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.423015    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" containerName="manager" containerID="cri-o://dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4" gracePeriod=2
Jul 16 17:43:15.427823 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.427397    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.427823 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.427537    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"]
Jul 16 17:43:15.439387 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.439356    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"]
Jul 16 17:43:15.439639 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.439610    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" containerName="manager" containerID="cri-o://ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65" gracePeriod=2
Jul 16 17:43:15.442250 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.442215    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.451522 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.451281    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.453997 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.453969    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"]
Jul 16 17:43:15.454164 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.453960    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.455953 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.455924    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:15.456518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456412    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" containerName="manager"
Jul 16 17:43:15.456518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456431    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" containerName="manager"
Jul 16 17:43:15.456518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456451    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" containerName="manager"
Jul 16 17:43:15.456518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456460    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" containerName="manager"
Jul 16 17:43:15.456786 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456540    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" containerName="manager"
Jul 16 17:43:15.456786 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.456550    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" containerName="manager"
Jul 16 17:43:15.456786 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.456607    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.459842 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.459789    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.462446 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.462414    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.463854 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.463828    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"]
Jul 16 17:43:15.469484 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.469347    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:15.470878 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.470814    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:15.480152 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.480129    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"]
Jul 16 17:43:15.484845 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.484813    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.487541 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.487370    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.513427 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.513388    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.555436 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.555405    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:43:15.560239 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.560211    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.562753 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.562724    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.573913 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.573887    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:43:15.590932 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.590890    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.628927 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.628886    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mddk4\" (UniqueName: \"kubernetes.io/projected/bad879c2-faaf-4c33-92e6-b44b5b407d6d-kube-api-access-mddk4\") pod \"limitador-operator-controller-manager-859d7b78bd-4d9pj\" (UID: \"bad879c2-faaf-4c33-92e6-b44b5b407d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:15.629097 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.628947    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.629097 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.629040    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58xjw\" (UniqueName: \"kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.729813 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.729717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.729813 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.729784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pft86\" (UniqueName: \"kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.730020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.729862    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58xjw\" (UniqueName: \"kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.730020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.729949    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.730020 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.729987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mddk4\" (UniqueName: \"kubernetes.io/projected/bad879c2-faaf-4c33-92e6-b44b5b407d6d-kube-api-access-mddk4\") pod \"limitador-operator-controller-manager-859d7b78bd-4d9pj\" (UID: \"bad879c2-faaf-4c33-92e6-b44b5b407d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:15.730224 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.730192    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.741121 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.741089    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58xjw\" (UniqueName: \"kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-cr97r\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.741121 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.741105    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mddk4\" (UniqueName: \"kubernetes.io/projected/bad879c2-faaf-4c33-92e6-b44b5b407d6d-kube-api-access-mddk4\") pod \"limitador-operator-controller-manager-859d7b78bd-4d9pj\" (UID: \"bad879c2-faaf-4c33-92e6-b44b5b407d6d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:15.830718 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.830680    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:15.831055 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.831023    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.831138 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.831118    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pft86\" (UniqueName: \"kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.831495 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.831464    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.839145 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.839123    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:15.843202 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.843060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pft86\" (UniqueName: \"kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86\") pod \"kuadrant-operator-controller-manager-86878c769f-2pclp\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.873649 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.873585    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:15.922706 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.922663    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:15.924829 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:15.924802    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:15.991896 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:15.991801    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:16.091152 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:16.091107    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:16.445481 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:16.445453    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-zmg4h"
Jul 16 17:43:20.760214 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:20.760122    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:20.895866 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:20.895824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:24.543807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:24.543761    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:24.643501 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:24.643457    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:29.107200 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.106693    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.109924 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.109886    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.110330 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.110308    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.112827 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.112801    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.114948 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.114922    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.147380 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.147353    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume\") pod \"5f2b7025-94e8-40b6-84f5-9045c0641f52\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") "
Jul 16 17:43:29.148761 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.147403    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r759l\" (UniqueName: \"kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l\") pod \"aaf9bc95-32fb-4426-b319-ba765b5b35a2\" (UID: \"aaf9bc95-32fb-4426-b319-ba765b5b35a2\") "
Jul 16 17:43:29.148761 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.147453    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rc9ns\" (UniqueName: \"kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns\") pod \"5f2b7025-94e8-40b6-84f5-9045c0641f52\" (UID: \"5f2b7025-94e8-40b6-84f5-9045c0641f52\") "
Jul 16 17:43:29.148761 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.148264    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5f2b7025-94e8-40b6-84f5-9045c0641f52" (UID: "5f2b7025-94e8-40b6-84f5-9045c0641f52"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:43:29.149028 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.148783    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5f2b7025-94e8-40b6-84f5-9045c0641f52-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:43:29.150999 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.150946    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l" (OuterVolumeSpecName: "kube-api-access-r759l") pod "aaf9bc95-32fb-4426-b319-ba765b5b35a2" (UID: "aaf9bc95-32fb-4426-b319-ba765b5b35a2"). InnerVolumeSpecName "kube-api-access-r759l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:43:29.151086 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.151020    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns" (OuterVolumeSpecName: "kube-api-access-rc9ns") pod "5f2b7025-94e8-40b6-84f5-9045c0641f52" (UID: "5f2b7025-94e8-40b6-84f5-9045c0641f52"). InnerVolumeSpecName "kube-api-access-rc9ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:43:29.169121 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.169093    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:43:29.171615 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:29.171587    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3967fb3e_c1b6_4a4a_90f4_5d2fab7dfcdc.slice/crio-e42cd239168ced494788db9b601d6f1887d5014142447cc523163808c2017c95 WatchSource:0}: Error finding container e42cd239168ced494788db9b601d6f1887d5014142447cc523163808c2017c95: Status 404 returned error can't find the container with id e42cd239168ced494788db9b601d6f1887d5014142447cc523163808c2017c95
Jul 16 17:43:29.191530 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.191507    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:29.193348 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:29.193320    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0dad763_11a1_4f89_adef_6be9878f2102.slice/crio-4dfcc7a190aaac76b28dfd9f620d0e2e4b5d84248e48de8cc766e38f0f67e4e2 WatchSource:0}: Error finding container 4dfcc7a190aaac76b28dfd9f620d0e2e4b5d84248e48de8cc766e38f0f67e4e2: Status 404 returned error can't find the container with id 4dfcc7a190aaac76b28dfd9f620d0e2e4b5d84248e48de8cc766e38f0f67e4e2
Jul 16 17:43:29.208834 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.208813    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"]
Jul 16 17:43:29.210927 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:43:29.210899    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad879c2_faaf_4c33_92e6_b44b5b407d6d.slice/crio-5643dab530b8fdfb9fdf90d3dce61ef50cc54c0573b47c1bb72a5e2baa242f13 WatchSource:0}: Error finding container 5643dab530b8fdfb9fdf90d3dce61ef50cc54c0573b47c1bb72a5e2baa242f13: Status 404 returned error can't find the container with id 5643dab530b8fdfb9fdf90d3dce61ef50cc54c0573b47c1bb72a5e2baa242f13
Jul 16 17:43:29.249246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.249216    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r759l\" (UniqueName: \"kubernetes.io/projected/aaf9bc95-32fb-4426-b319-ba765b5b35a2-kube-api-access-r759l\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:43:29.249246 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.249242    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rc9ns\" (UniqueName: \"kubernetes.io/projected/5f2b7025-94e8-40b6-84f5-9045c0641f52-kube-api-access-rc9ns\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:43:29.584989 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.584904    2577 generic.go:356] "Generic (PLEG): container finished" podID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" containerID="ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65" exitCode=0
Jul 16 17:43:29.584989 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.584951    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.584989 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.584987    2577 scope.go:117] "RemoveContainer" containerID="ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65"
Jul 16 17:43:29.586844 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.586819    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" event={"ID":"b0dad763-11a1-4f89-adef-6be9878f2102","Type":"ContainerStarted","Data":"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"}
Jul 16 17:43:29.586983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.586870    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" event={"ID":"b0dad763-11a1-4f89-adef-6be9878f2102","Type":"ContainerStarted","Data":"4dfcc7a190aaac76b28dfd9f620d0e2e4b5d84248e48de8cc766e38f0f67e4e2"}
Jul 16 17:43:29.586983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.586903    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:29.587705 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.587671    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.588671 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.588644    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" event={"ID":"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc","Type":"ContainerStarted","Data":"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"}
Jul 16 17:43:29.588755 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.588695    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" event={"ID":"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc","Type":"ContainerStarted","Data":"e42cd239168ced494788db9b601d6f1887d5014142447cc523163808c2017c95"}
Jul 16 17:43:29.588807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.588772    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:29.589842 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.589814    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.590348 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.590320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh" event={"ID":"1756b7b7-96d1-4789-b42e-5e270b1855ba","Type":"ContainerStarted","Data":"93fc969c98e2f1b1c7d8cd76d511ad90b0e19d5c99eec5e82d6ae69cddce42ef"}
Jul 16 17:43:29.591676 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.591655    2577 generic.go:356] "Generic (PLEG): container finished" podID="5f2b7025-94e8-40b6-84f5-9045c0641f52" containerID="dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4" exitCode=0
Jul 16 17:43:29.591780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.591684    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.592079 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.592052    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.593264 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.593241    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj" event={"ID":"bad879c2-faaf-4c33-92e6-b44b5b407d6d","Type":"ContainerStarted","Data":"2665badcf54ad800725e58264838b5191ffa1de84ea8cc596cda2b7c44abac74"}
Jul 16 17:43:29.593384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.593283    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj" event={"ID":"bad879c2-faaf-4c33-92e6-b44b5b407d6d","Type":"ContainerStarted","Data":"5643dab530b8fdfb9fdf90d3dce61ef50cc54c0573b47c1bb72a5e2baa242f13"}
Jul 16 17:43:29.593384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.593343    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:29.595617 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.595599    2577 scope.go:117] "RemoveContainer" containerID="ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65"
Jul 16 17:43:29.595887 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.595864    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65\": container with ID starting with ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65 not found: ID does not exist" containerID="ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65"
Jul 16 17:43:29.595944 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.595897    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65"} err="failed to get container status \"ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65\": rpc error: code = NotFound desc = could not find container \"ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65\": container with ID starting with ab12636d2133c48a99eaf9e9b174a688e9a58e6d46a35fdd03da419d233f6a65 not found: ID does not exist"
Jul 16 17:43:29.595944 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.595920    2577 scope.go:117] "RemoveContainer" containerID="dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4"
Jul 16 17:43:29.604410 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.604393    2577 scope.go:117] "RemoveContainer" containerID="dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4"
Jul 16 17:43:29.604643 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.604628    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4\": container with ID starting with dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4 not found: ID does not exist" containerID="dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4"
Jul 16 17:43:29.604683 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.604650    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4"} err="failed to get container status \"dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4\": rpc error: code = NotFound desc = could not find container \"dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4\": container with ID starting with dbbe1ecccad4d28ba74e5854b49cf99833da7658de342263426361525a58cce4 not found: ID does not exist"
Jul 16 17:43:29.634225 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.634164    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" podStartSLOduration=14.634108287 podStartE2EDuration="14.634108287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:29.611862477 +0000 UTC m=+634.256085370" watchObservedRunningTime="2026-07-16 17:43:29.634108287 +0000 UTC m=+634.278331183"
Jul 16 17:43:29.635261 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.635231    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" podStartSLOduration=14.635218064 podStartE2EDuration="14.635218064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:29.633415189 +0000 UTC m=+634.277638073" watchObservedRunningTime="2026-07-16 17:43:29.635218064 +0000 UTC m=+634.279440942"
Jul 16 17:43:29.635497 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.635470    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.637648 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.637625    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-qvrs8\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-qvrs8"
Jul 16 17:43:29.659990 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.659948    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj" podStartSLOduration=14.659934641 podStartE2EDuration="14.659934641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:29.657351848 +0000 UTC m=+634.301574727" watchObservedRunningTime="2026-07-16 17:43:29.659934641 +0000 UTC m=+634.304157520"
Jul 16 17:43:29.675916 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.675871    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-262zh" podStartSLOduration=2.699676941 podStartE2EDuration="25.67585676s" totalImagesPullingTime="22.976179819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:43:29.674325214 +0000 UTC m=+634.318548094" watchObservedRunningTime="2026-07-16 17:43:29.67585676 +0000 UTC m=+634.320079677"
Jul 16 17:43:29.676467 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:29.676441    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kzlr4\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kzlr4"
Jul 16 17:43:29.922903 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.922871    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f2b7025-94e8-40b6-84f5-9045c0641f52" path="/var/lib/kubelet/pods/5f2b7025-94e8-40b6-84f5-9045c0641f52/volumes"
Jul 16 17:43:29.923197 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:29.923184    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaf9bc95-32fb-4426-b319-ba765b5b35a2" path="/var/lib/kubelet/pods/aaf9bc95-32fb-4426-b319-ba765b5b35a2/volumes"
Jul 16 17:43:30.004271 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:30.004228    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:33.286547 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:33.286506    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:33.409827 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:33.409795    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:35.797495 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:35.797460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:35.903208 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:35.903175    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:37.863243 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:37.863205    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:40.474645 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.474608    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:40.586847 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.586809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:40.609170 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.609146    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:40.609337 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.609210    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4d9pj"
Jul 16 17:43:40.609384 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.609368    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:43:40.730786 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.730701    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:40.730933 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.730877    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" podUID="b0dad763-11a1-4f89-adef-6be9878f2102" containerName="manager" containerID="cri-o://3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71" gracePeriod=10
Jul 16 17:43:40.977952 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:40.977930    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:41.051239 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.051207    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume\") pod \"b0dad763-11a1-4f89-adef-6be9878f2102\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") "
Jul 16 17:43:41.051448 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.051334    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-58xjw\" (UniqueName: \"kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw\") pod \"b0dad763-11a1-4f89-adef-6be9878f2102\" (UID: \"b0dad763-11a1-4f89-adef-6be9878f2102\") "
Jul 16 17:43:41.051692 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.051666    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0dad763-11a1-4f89-adef-6be9878f2102" (UID: "b0dad763-11a1-4f89-adef-6be9878f2102"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:43:41.053413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.053386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw" (OuterVolumeSpecName: "kube-api-access-58xjw") pod "b0dad763-11a1-4f89-adef-6be9878f2102" (UID: "b0dad763-11a1-4f89-adef-6be9878f2102"). InnerVolumeSpecName "kube-api-access-58xjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:43:41.151857 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.151813    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-58xjw\" (UniqueName: \"kubernetes.io/projected/b0dad763-11a1-4f89-adef-6be9878f2102-kube-api-access-58xjw\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:43:41.151857 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.151845    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0dad763-11a1-4f89-adef-6be9878f2102-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:43:41.665583 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.665545    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0dad763-11a1-4f89-adef-6be9878f2102" containerID="3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71" exitCode=0
Jul 16 17:43:41.666012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.665621    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"
Jul 16 17:43:41.666012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.665631    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" event={"ID":"b0dad763-11a1-4f89-adef-6be9878f2102","Type":"ContainerDied","Data":"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"}
Jul 16 17:43:41.666012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.665711    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r" event={"ID":"b0dad763-11a1-4f89-adef-6be9878f2102","Type":"ContainerDied","Data":"4dfcc7a190aaac76b28dfd9f620d0e2e4b5d84248e48de8cc766e38f0f67e4e2"}
Jul 16 17:43:41.666012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.665734    2577 scope.go:117] "RemoveContainer" containerID="3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"
Jul 16 17:43:41.675037 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.675023    2577 scope.go:117] "RemoveContainer" containerID="3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"
Jul 16 17:43:41.675374 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:43:41.675355    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71\": container with ID starting with 3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71 not found: ID does not exist" containerID="3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"
Jul 16 17:43:41.675429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.675383    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71"} err="failed to get container status \"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71\": rpc error: code = NotFound desc = could not find container \"3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71\": container with ID starting with 3968744dd98a0aa4c9e47b2630f35bc7d8b3ccc5ab156a8428dff30f78f08e71 not found: ID does not exist"
Jul 16 17:43:41.717218 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.717188    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:41.729178 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.729151    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-cr97r"]
Jul 16 17:43:41.923580 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:41.923499    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0dad763-11a1-4f89-adef-6be9878f2102" path="/var/lib/kubelet/pods/b0dad763-11a1-4f89-adef-6be9878f2102/volumes"
Jul 16 17:43:46.810400 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:46.810361    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:57.301750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:57.301719    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:57.635207 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:57.635171    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:59.377354 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.377322    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:43:59.377893 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.377844    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0dad763-11a1-4f89-adef-6be9878f2102" containerName="manager"
Jul 16 17:43:59.377893 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.377863    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0dad763-11a1-4f89-adef-6be9878f2102" containerName="manager"
Jul 16 17:43:59.378009 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.377961    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0dad763-11a1-4f89-adef-6be9878f2102" containerName="manager"
Jul 16 17:43:59.407265 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.407234    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:59.504762 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.504725    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:59.608160 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.608124    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:43:59.617389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.617366    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:43:59.617389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.617396    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:43:59.617599 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.617467    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.620565 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.620541    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 16 17:43:59.716148 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.716053    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct762\" (UniqueName: \"kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.716319 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.716152    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.817510 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.817475    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct762\" (UniqueName: \"kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.817675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.817518    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.818119 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.818102    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.826968 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.826943    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct762\" (UniqueName: \"kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762\") pod \"limitador-limitador-64c94fd64f-w5pfb\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:43:59.928438 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:43:59.928403    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:44:00.081115 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.081085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:44:00.082767 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:00.082736    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9679df46_084d_4a25_9d72_b6e7d61c0b79.slice/crio-638c765589dbeecfd5c15a961a719712dbf3717d37e6228f056cdf0e78631fca WatchSource:0}: Error finding container 638c765589dbeecfd5c15a961a719712dbf3717d37e6228f056cdf0e78631fca: Status 404 returned error can't find the container with id 638c765589dbeecfd5c15a961a719712dbf3717d37e6228f056cdf0e78631fca
Jul 16 17:44:00.084813 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.084797    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:44:00.309880 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.309794    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:00.335503 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.335474    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:00.335659 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.335567    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:00.338508 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.338486    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-95q7m\""
Jul 16 17:44:00.352040 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.352016    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:00.419498 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.419455    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:00.423449 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.423429    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5vsj\" (UniqueName: \"kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj\") pod \"authorino-58cd955675-lz6z9\" (UID: \"df313187-5f54-4188-a5a6-c39ce58f07bf\") " pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:00.524807 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.524777    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5vsj\" (UniqueName: \"kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj\") pod \"authorino-58cd955675-lz6z9\" (UID: \"df313187-5f54-4188-a5a6-c39ce58f07bf\") " pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:00.536505 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.536473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5vsj\" (UniqueName: \"kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj\") pod \"authorino-58cd955675-lz6z9\" (UID: \"df313187-5f54-4188-a5a6-c39ce58f07bf\") " pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:00.646659 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.646629    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:00.768011 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.767977    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" event={"ID":"9679df46-084d-4a25-9d72-b6e7d61c0b79","Type":"ContainerStarted","Data":"638c765589dbeecfd5c15a961a719712dbf3717d37e6228f056cdf0e78631fca"}
Jul 16 17:44:00.781201 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:00.781180    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:00.782121 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:00.782095    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf313187_5f54_4188_a5a6_c39ce58f07bf.slice/crio-d593ce7d849aace07a130b0375c2768160260c953349cde6efd3c0672e41149d WatchSource:0}: Error finding container d593ce7d849aace07a130b0375c2768160260c953349cde6efd3c0672e41149d: Status 404 returned error can't find the container with id d593ce7d849aace07a130b0375c2768160260c953349cde6efd3c0672e41149d
Jul 16 17:44:01.781375 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:01.781336    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lz6z9" event={"ID":"df313187-5f54-4188-a5a6-c39ce58f07bf","Type":"ContainerStarted","Data":"d593ce7d849aace07a130b0375c2768160260c953349cde6efd3c0672e41149d"}
Jul 16 17:44:05.680675 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.680640    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:05.806342 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.806299    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lz6z9" event={"ID":"df313187-5f54-4188-a5a6-c39ce58f07bf","Type":"ContainerStarted","Data":"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"}
Jul 16 17:44:05.807726 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.807702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" event={"ID":"9679df46-084d-4a25-9d72-b6e7d61c0b79","Type":"ContainerStarted","Data":"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"}
Jul 16 17:44:05.807846 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.807800    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:44:05.825853 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.825804    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-lz6z9" podStartSLOduration=1.6946968340000002 podStartE2EDuration="5.825789593s" totalImagesPullingTime="4.131092759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:05.824379357 +0000 UTC m=+670.468602237" watchObservedRunningTime="2026-07-16 17:44:05.825789593 +0000 UTC m=+670.470012472"
Jul 16 17:44:05.844942 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:05.844884    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" podStartSLOduration=2.026859798 podStartE2EDuration="6.844864242s" totalImagesPullingTime="4.818004444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:05.844744366 +0000 UTC m=+670.488967245" watchObservedRunningTime="2026-07-16 17:44:05.844864242 +0000 UTC m=+670.489087124"
Jul 16 17:44:06.812791 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:06.812750    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-lz6z9" podUID="df313187-5f54-4188-a5a6-c39ce58f07bf" containerName="authorino" containerID="cri-o://0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e" gracePeriod=30
Jul 16 17:44:07.068089 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.068031    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:07.188583 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.188547    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5vsj\" (UniqueName: \"kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj\") pod \"df313187-5f54-4188-a5a6-c39ce58f07bf\" (UID: \"df313187-5f54-4188-a5a6-c39ce58f07bf\") "
Jul 16 17:44:07.190625 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.190599    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj" (OuterVolumeSpecName: "kube-api-access-t5vsj") pod "df313187-5f54-4188-a5a6-c39ce58f07bf" (UID: "df313187-5f54-4188-a5a6-c39ce58f07bf"). InnerVolumeSpecName "kube-api-access-t5vsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:07.289657 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.289624    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5vsj\" (UniqueName: \"kubernetes.io/projected/df313187-5f54-4188-a5a6-c39ce58f07bf-kube-api-access-t5vsj\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:07.818711 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.818678    2577 generic.go:356] "Generic (PLEG): container finished" podID="df313187-5f54-4188-a5a6-c39ce58f07bf" containerID="0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e" exitCode=0
Jul 16 17:44:07.819123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.818720    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-lz6z9"
Jul 16 17:44:07.819123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.818759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lz6z9" event={"ID":"df313187-5f54-4188-a5a6-c39ce58f07bf","Type":"ContainerDied","Data":"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"}
Jul 16 17:44:07.819123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.818798    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-lz6z9" event={"ID":"df313187-5f54-4188-a5a6-c39ce58f07bf","Type":"ContainerDied","Data":"d593ce7d849aace07a130b0375c2768160260c953349cde6efd3c0672e41149d"}
Jul 16 17:44:07.819123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.818869    2577 scope.go:117] "RemoveContainer" containerID="0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"
Jul 16 17:44:07.828073 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.828058    2577 scope.go:117] "RemoveContainer" containerID="0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"
Jul 16 17:44:07.828364 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:07.828341    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e\": container with ID starting with 0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e not found: ID does not exist" containerID="0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"
Jul 16 17:44:07.828417 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.828379    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e"} err="failed to get container status \"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e\": rpc error: code = NotFound desc = could not find container \"0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e\": container with ID starting with 0c9808312ee3d3af7c5455bbf313d07d2f616203fec5b23a00a049f7b691ca4e not found: ID does not exist"
Jul 16 17:44:07.849828 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.849801    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:07.853433 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.853411    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-lz6z9"]
Jul 16 17:44:07.922711 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:07.922678    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df313187-5f54-4188-a5a6-c39ce58f07bf" path="/var/lib/kubelet/pods/df313187-5f54-4188-a5a6-c39ce58f07bf/volumes"
Jul 16 17:44:16.718016 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:16.717978    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:44:16.718612 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:16.718175    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" podUID="9679df46-084d-4a25-9d72-b6e7d61c0b79" containerName="limitador" containerID="cri-o://5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f" gracePeriod=30
Jul 16 17:44:16.718938 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:16.718874    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:44:17.271157 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.271129    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:44:17.379114 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.379084    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file\") pod \"9679df46-084d-4a25-9d72-b6e7d61c0b79\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") "
Jul 16 17:44:17.379339 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.379206    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ct762\" (UniqueName: \"kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762\") pod \"9679df46-084d-4a25-9d72-b6e7d61c0b79\" (UID: \"9679df46-084d-4a25-9d72-b6e7d61c0b79\") "
Jul 16 17:44:17.379553 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.379522    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file" (OuterVolumeSpecName: "config-file") pod "9679df46-084d-4a25-9d72-b6e7d61c0b79" (UID: "9679df46-084d-4a25-9d72-b6e7d61c0b79"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 17:44:17.381261 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.381235    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762" (OuterVolumeSpecName: "kube-api-access-ct762") pod "9679df46-084d-4a25-9d72-b6e7d61c0b79" (UID: "9679df46-084d-4a25-9d72-b6e7d61c0b79"). InnerVolumeSpecName "kube-api-access-ct762". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:17.480398 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.480360    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ct762\" (UniqueName: \"kubernetes.io/projected/9679df46-084d-4a25-9d72-b6e7d61c0b79-kube-api-access-ct762\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:17.480398 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.480391    2577 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9679df46-084d-4a25-9d72-b6e7d61c0b79-config-file\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:17.883270 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.883235    2577 generic.go:356] "Generic (PLEG): container finished" podID="9679df46-084d-4a25-9d72-b6e7d61c0b79" containerID="5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f" exitCode=0
Jul 16 17:44:17.883764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.883284    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" event={"ID":"9679df46-084d-4a25-9d72-b6e7d61c0b79","Type":"ContainerDied","Data":"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"}
Jul 16 17:44:17.883764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.883309    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"
Jul 16 17:44:17.883764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.883381    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w5pfb" event={"ID":"9679df46-084d-4a25-9d72-b6e7d61c0b79","Type":"ContainerDied","Data":"638c765589dbeecfd5c15a961a719712dbf3717d37e6228f056cdf0e78631fca"}
Jul 16 17:44:17.883764 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.883405    2577 scope.go:117] "RemoveContainer" containerID="5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"
Jul 16 17:44:17.892681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.892650    2577 scope.go:117] "RemoveContainer" containerID="5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"
Jul 16 17:44:17.892992 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:17.892971    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f\": container with ID starting with 5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f not found: ID does not exist" containerID="5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"
Jul 16 17:44:17.893085 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.893003    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f"} err="failed to get container status \"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f\": rpc error: code = NotFound desc = could not find container \"5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f\": container with ID starting with 5770b896de9aa5ae697e54aabe4903db69a832c892745bef31957129c9ae927f not found: ID does not exist"
Jul 16 17:44:17.912794 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.912758    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:44:17.915544 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.915520    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w5pfb"]
Jul 16 17:44:17.922389 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:17.922365    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9679df46-084d-4a25-9d72-b6e7d61c0b79" path="/var/lib/kubelet/pods/9679df46-084d-4a25-9d72-b6e7d61c0b79/volumes"
Jul 16 17:44:20.700947 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:20.700911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:21.132683 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.132649    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"]
Jul 16 17:44:21.132997 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.132985    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df313187-5f54-4188-a5a6-c39ce58f07bf" containerName="authorino"
Jul 16 17:44:21.133045 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.132998    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="df313187-5f54-4188-a5a6-c39ce58f07bf" containerName="authorino"
Jul 16 17:44:21.133045 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.133011    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9679df46-084d-4a25-9d72-b6e7d61c0b79" containerName="limitador"
Jul 16 17:44:21.133045 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.133016    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9679df46-084d-4a25-9d72-b6e7d61c0b79" containerName="limitador"
Jul 16 17:44:21.133149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.133083    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9679df46-084d-4a25-9d72-b6e7d61c0b79" containerName="limitador"
Jul 16 17:44:21.133149 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.133091    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="df313187-5f54-4188-a5a6-c39ce58f07bf" containerName="authorino"
Jul 16 17:44:21.135366 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.135348    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.138342 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.138320    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 16 17:44:21.138473 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.138346    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 16 17:44:21.138473 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.138349    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 16 17:44:21.139328 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.139311    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xqscp\""
Jul 16 17:44:21.146005 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.145986    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"]
Jul 16 17:44:21.208361 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.208329    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9b41703a-d8a4-414c-ae6e-d831ee334320-data\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.208361 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.208367    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krr96\" (UniqueName: \"kubernetes.io/projected/9b41703a-d8a4-414c-ae6e-d831ee334320-kube-api-access-krr96\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.308909 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.308875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krr96\" (UniqueName: \"kubernetes.io/projected/9b41703a-d8a4-414c-ae6e-d831ee334320-kube-api-access-krr96\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.309078 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.308996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9b41703a-d8a4-414c-ae6e-d831ee334320-data\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.309430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.309413    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9b41703a-d8a4-414c-ae6e-d831ee334320-data\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.320763 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.320735    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krr96\" (UniqueName: \"kubernetes.io/projected/9b41703a-d8a4-414c-ae6e-d831ee334320-kube-api-access-krr96\") pod \"postgres-69fb4594cf-qh9mv\" (UID: \"9b41703a-d8a4-414c-ae6e-d831ee334320\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.446413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.446319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:21.588608 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.588580    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"]
Jul 16 17:44:21.591726 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:21.591701    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b41703a_d8a4_414c_ae6e_d831ee334320.slice/crio-376790f2c92885296026df67e56f76f3fa5bb3b83939c713b95dbb2676027949 WatchSource:0}: Error finding container 376790f2c92885296026df67e56f76f3fa5bb3b83939c713b95dbb2676027949: Status 404 returned error can't find the container with id 376790f2c92885296026df67e56f76f3fa5bb3b83939c713b95dbb2676027949
Jul 16 17:44:21.906025 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:21.905994    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv" event={"ID":"9b41703a-d8a4-414c-ae6e-d831ee334320","Type":"ContainerStarted","Data":"376790f2c92885296026df67e56f76f3fa5bb3b83939c713b95dbb2676027949"}
Jul 16 17:44:22.112129 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:22.112075    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:26.940413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:26.940277    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv" event={"ID":"9b41703a-d8a4-414c-ae6e-d831ee334320","Type":"ContainerStarted","Data":"db8aa3981e152250db438bfaee3c7a3792cb649c6a846be9cc6c97a696e11cc3"}
Jul 16 17:44:26.940413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:26.940371    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:26.962517 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:26.962467    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv" podStartSLOduration=0.923062052 podStartE2EDuration="5.96245036s" totalImagesPullingTime="5.039388308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:26.96093084 +0000 UTC m=+691.605153721" watchObservedRunningTime="2026-07-16 17:44:26.96245036 +0000 UTC m=+691.606673283"
Jul 16 17:44:32.976323 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:32.976276    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qh9mv"
Jul 16 17:44:33.359949 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.359859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:33.613941 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.613864    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:33.620537 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.620511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:33.623322 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.623275    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-95q7m\""
Jul 16 17:44:33.631026 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.631002    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:33.718705 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.718659    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngttj\" (UniqueName: \"kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj\") pod \"authorino-5d4b67c446-4b7bm\" (UID: \"27d43551-26c3-4654-ad30-346ab012f3f2\") " pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:33.735453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.735401    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:33.819945 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.819909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ngttj\" (UniqueName: \"kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj\") pod \"authorino-5d4b67c446-4b7bm\" (UID: \"27d43551-26c3-4654-ad30-346ab012f3f2\") " pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:33.843054 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.843024    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngttj\" (UniqueName: \"kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj\") pod \"authorino-5d4b67c446-4b7bm\" (UID: \"27d43551-26c3-4654-ad30-346ab012f3f2\") " pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:33.911736 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.911701    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:33.911951 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.911940    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:33.940256 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.940219    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:33.947663 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.947632    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:33.955079 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:33.955050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:34.021918 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.021878    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdnzm\" (UniqueName: \"kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm\") pod \"authorino-5cc655fc4c-xsrhb\" (UID: \"1218728e-3b25-4a67-81fc-805fd8d172f1\") " pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:34.068068 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.068042    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:34.070138 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:34.070105    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27d43551_26c3_4654_ad30_346ab012f3f2.slice/crio-3124f0c83396595ed16c03a6bcf0db9377214398f10600e70e3296e929c0e135 WatchSource:0}: Error finding container 3124f0c83396595ed16c03a6bcf0db9377214398f10600e70e3296e929c0e135: Status 404 returned error can't find the container with id 3124f0c83396595ed16c03a6bcf0db9377214398f10600e70e3296e929c0e135
Jul 16 17:44:34.122486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.122450    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdnzm\" (UniqueName: \"kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm\") pod \"authorino-5cc655fc4c-xsrhb\" (UID: \"1218728e-3b25-4a67-81fc-805fd8d172f1\") " pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:34.133571 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.133545    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdnzm\" (UniqueName: \"kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm\") pod \"authorino-5cc655fc4c-xsrhb\" (UID: \"1218728e-3b25-4a67-81fc-805fd8d172f1\") " pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:34.202693 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.202612    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:34.202843 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.202832    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:34.232885 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.232844    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:44:34.238618 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.238593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.241775 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.241701    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 16 17:44:34.243600 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.243574    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:44:34.325039 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.324991    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwchn\" (UniqueName: \"kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.325199 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.325066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.344235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.344211    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:34.346025 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:34.346004    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1218728e_3b25_4a67_81fc_805fd8d172f1.slice/crio-6834f7f1cffca2b02f35e57d8955777e9927573db953f7bb1545409915146ea9 WatchSource:0}: Error finding container 6834f7f1cffca2b02f35e57d8955777e9927573db953f7bb1545409915146ea9: Status 404 returned error can't find the container with id 6834f7f1cffca2b02f35e57d8955777e9927573db953f7bb1545409915146ea9
Jul 16 17:44:34.426478 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.426440    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwchn\" (UniqueName: \"kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.426640 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.426497    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.428930 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.428906    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.437054 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.437031    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwchn\" (UniqueName: \"kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn\") pod \"authorino-5fbcfc658c-75jqv\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") " pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.550813 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.550785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:44:34.703060 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.703032    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:44:34.705331 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:34.705281    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6050b9db_5843_4bb1_baa8_d49bb2f1ff7c.slice/crio-49012ad4ddd5a45753810aba8fdbf2f5d28c572705452792d6fd90585a721841 WatchSource:0}: Error finding container 49012ad4ddd5a45753810aba8fdbf2f5d28c572705452792d6fd90585a721841: Status 404 returned error can't find the container with id 49012ad4ddd5a45753810aba8fdbf2f5d28c572705452792d6fd90585a721841
Jul 16 17:44:34.987562 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.987528    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" event={"ID":"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c","Type":"ContainerStarted","Data":"49012ad4ddd5a45753810aba8fdbf2f5d28c572705452792d6fd90585a721841"}
Jul 16 17:44:34.988983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.988960    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" event={"ID":"27d43551-26c3-4654-ad30-346ab012f3f2","Type":"ContainerStarted","Data":"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"}
Jul 16 17:44:34.989128 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.988992    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" event={"ID":"27d43551-26c3-4654-ad30-346ab012f3f2","Type":"ContainerStarted","Data":"3124f0c83396595ed16c03a6bcf0db9377214398f10600e70e3296e929c0e135"}
Jul 16 17:44:34.989128 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.988986    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" podUID="27d43551-26c3-4654-ad30-346ab012f3f2" containerName="authorino" containerID="cri-o://70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7" gracePeriod=30
Jul 16 17:44:34.990570 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.990548    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" event={"ID":"1218728e-3b25-4a67-81fc-805fd8d172f1","Type":"ContainerStarted","Data":"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"}
Jul 16 17:44:34.990665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.990582    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" event={"ID":"1218728e-3b25-4a67-81fc-805fd8d172f1","Type":"ContainerStarted","Data":"6834f7f1cffca2b02f35e57d8955777e9927573db953f7bb1545409915146ea9"}
Jul 16 17:44:34.990665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:34.990612    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" podUID="1218728e-3b25-4a67-81fc-805fd8d172f1" containerName="authorino" containerID="cri-o://195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001" gracePeriod=30
Jul 16 17:44:35.016460 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.016119    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" podStartSLOduration=1.613156079 podStartE2EDuration="2.016098582s" totalImagesPullingTime="402.942503ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:35.015984913 +0000 UTC m=+699.660207803" watchObservedRunningTime="2026-07-16 17:44:35.016098582 +0000 UTC m=+699.660321466"
Jul 16 17:44:35.035988 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.035942    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" podStartSLOduration=1.614221432 podStartE2EDuration="2.035927266s" totalImagesPullingTime="421.705834ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:35.035436149 +0000 UTC m=+699.679659022" watchObservedRunningTime="2026-07-16 17:44:35.035927266 +0000 UTC m=+699.680150144"
Jul 16 17:44:35.251251 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.251221    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:35.262821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.262798    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:35.335624 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.335538    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdnzm\" (UniqueName: \"kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm\") pod \"1218728e-3b25-4a67-81fc-805fd8d172f1\" (UID: \"1218728e-3b25-4a67-81fc-805fd8d172f1\") "
Jul 16 17:44:35.335792 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.335628    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngttj\" (UniqueName: \"kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj\") pod \"27d43551-26c3-4654-ad30-346ab012f3f2\" (UID: \"27d43551-26c3-4654-ad30-346ab012f3f2\") "
Jul 16 17:44:35.337564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.337530    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm" (OuterVolumeSpecName: "kube-api-access-zdnzm") pod "1218728e-3b25-4a67-81fc-805fd8d172f1" (UID: "1218728e-3b25-4a67-81fc-805fd8d172f1"). InnerVolumeSpecName "kube-api-access-zdnzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:35.337685 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.337599    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj" (OuterVolumeSpecName: "kube-api-access-ngttj") pod "27d43551-26c3-4654-ad30-346ab012f3f2" (UID: "27d43551-26c3-4654-ad30-346ab012f3f2"). InnerVolumeSpecName "kube-api-access-ngttj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:35.437234 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.437195    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdnzm\" (UniqueName: \"kubernetes.io/projected/1218728e-3b25-4a67-81fc-805fd8d172f1-kube-api-access-zdnzm\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:35.437234 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.437229    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngttj\" (UniqueName: \"kubernetes.io/projected/27d43551-26c3-4654-ad30-346ab012f3f2-kube-api-access-ngttj\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:35.996334 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.996276    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" event={"ID":"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c","Type":"ContainerStarted","Data":"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"}
Jul 16 17:44:35.997429 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.997405    2577 generic.go:356] "Generic (PLEG): container finished" podID="27d43551-26c3-4654-ad30-346ab012f3f2" containerID="70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7" exitCode=0
Jul 16 17:44:35.997564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.997437    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b7bm"
Jul 16 17:44:35.997564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.997477    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" event={"ID":"27d43551-26c3-4654-ad30-346ab012f3f2","Type":"ContainerDied","Data":"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"}
Jul 16 17:44:35.997564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.997516    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-4b7bm" event={"ID":"27d43551-26c3-4654-ad30-346ab012f3f2","Type":"ContainerDied","Data":"3124f0c83396595ed16c03a6bcf0db9377214398f10600e70e3296e929c0e135"}
Jul 16 17:44:35.997564 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.997540    2577 scope.go:117] "RemoveContainer" containerID="70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"
Jul 16 17:44:35.998858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.998752    2577 generic.go:356] "Generic (PLEG): container finished" podID="1218728e-3b25-4a67-81fc-805fd8d172f1" containerID="195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001" exitCode=0
Jul 16 17:44:35.998858 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.998793    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb"
Jul 16 17:44:35.998980 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.998797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" event={"ID":"1218728e-3b25-4a67-81fc-805fd8d172f1","Type":"ContainerDied","Data":"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"}
Jul 16 17:44:35.998980 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:35.998934    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5cc655fc4c-xsrhb" event={"ID":"1218728e-3b25-4a67-81fc-805fd8d172f1","Type":"ContainerDied","Data":"6834f7f1cffca2b02f35e57d8955777e9927573db953f7bb1545409915146ea9"}
Jul 16 17:44:36.006518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.006500    2577 scope.go:117] "RemoveContainer" containerID="70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"
Jul 16 17:44:36.006778 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:36.006760    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7\": container with ID starting with 70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7 not found: ID does not exist" containerID="70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"
Jul 16 17:44:36.006852 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.006789    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7"} err="failed to get container status \"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7\": rpc error: code = NotFound desc = could not find container \"70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7\": container with ID starting with 70004f867a75a7bbbfee62e5ebd877435afe29fd1c6b77ca0539c858d83673c7 not found: ID does not exist"
Jul 16 17:44:36.006852 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.006812    2577 scope.go:117] "RemoveContainer" containerID="195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"
Jul 16 17:44:36.014664 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.014647    2577 scope.go:117] "RemoveContainer" containerID="195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"
Jul 16 17:44:36.014940 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:36.014915    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001\": container with ID starting with 195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001 not found: ID does not exist" containerID="195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"
Jul 16 17:44:36.015027 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.014951    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001"} err="failed to get container status \"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001\": rpc error: code = NotFound desc = could not find container \"195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001\": container with ID starting with 195beb47d9c0dcd7d6c072042c02fc9ad8104c6ebb8283dc68dc8e4e1c7f6001 not found: ID does not exist"
Jul 16 17:44:36.023574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.023536    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" podStartSLOduration=1.72908057 podStartE2EDuration="2.023523236s" totalImagesPullingTime="294.442666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:36.022407364 +0000 UTC m=+700.666630244" watchObservedRunningTime="2026-07-16 17:44:36.023523236 +0000 UTC m=+700.667746115"
Jul 16 17:44:36.053859 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.053827    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:36.063978 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.063942    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b7bm"]
Jul 16 17:44:36.088123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.088091    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:36.096456 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:36.096424    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5cc655fc4c-xsrhb"]
Jul 16 17:44:37.923409 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:37.923374    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1218728e-3b25-4a67-81fc-805fd8d172f1" path="/var/lib/kubelet/pods/1218728e-3b25-4a67-81fc-805fd8d172f1/volumes"
Jul 16 17:44:37.923867 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:37.923717    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27d43551-26c3-4654-ad30-346ab012f3f2" path="/var/lib/kubelet/pods/27d43551-26c3-4654-ad30-346ab012f3f2/volumes"
Jul 16 17:44:41.017674 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.017641    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:41.023754 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.023718    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:41.024486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024463    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27d43551-26c3-4654-ad30-346ab012f3f2" containerName="authorino"
Jul 16 17:44:41.024486 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024488    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="27d43551-26c3-4654-ad30-346ab012f3f2" containerName="authorino"
Jul 16 17:44:41.024662 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024509    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1218728e-3b25-4a67-81fc-805fd8d172f1" containerName="authorino"
Jul 16 17:44:41.024662 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024515    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="1218728e-3b25-4a67-81fc-805fd8d172f1" containerName="authorino"
Jul 16 17:44:41.024662 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024595    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="27d43551-26c3-4654-ad30-346ab012f3f2" containerName="authorino"
Jul 16 17:44:41.024662 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.024610    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="1218728e-3b25-4a67-81fc-805fd8d172f1" containerName="authorino"
Jul 16 17:44:41.129181 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.129145    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:41.208480 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.208449    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:41.208692 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.208579    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.218545 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.218524    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:44:41.219282 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.219263    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:44:41.219924 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.219911    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tl5dq\""
Jul 16 17:44:41.224944 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.224911    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:41.249904 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.249874    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:44:41.282235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.282159    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:44:41.282235 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.282209    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.289128 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.289059    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.289325 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.289232    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z55c\" (UniqueName: \"kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.389862 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.389834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.389862 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.389867    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.390074 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.389900    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wv8vf\" (UniqueName: \"kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.390074 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.389974    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z55c\" (UniqueName: \"kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.390155 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:41.389984    2577 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 16 17:44:41.390191 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:41.390166    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert podName:b75fb1e4-3240-4b16-99d6-36b1b3175a4b nodeName:}" failed. No retries permitted until 2026-07-16 17:44:41.890147878 +0000 UTC m=+706.534370735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert") pod "maas-controller-bfdf69b79-hl469" (UID: "b75fb1e4-3240-4b16-99d6-36b1b3175a4b") : secret "maas-controller-webhook-cert" not found
Jul 16 17:44:41.403402 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.403370    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z55c\" (UniqueName: \"kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.460090 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.460035    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:41.491002 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.490967    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.491164 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.491008    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wv8vf\" (UniqueName: \"kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.493509 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.493485    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.501880 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.501856    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wv8vf\" (UniqueName: \"kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf\") pod \"maas-controller-5d4d6b9447-4292v\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") " pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.592518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.592424    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:41.766422 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.766394    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:44:41.767473 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:41.767442    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c4cc02b_cc22_43aa_b936_e40fb1d3e83e.slice/crio-7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc WatchSource:0}: Error finding container 7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc: Status 404 returned error can't find the container with id 7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc
Jul 16 17:44:41.895677 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.895638    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:41.898013 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:41.897984    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") pod \"maas-controller-bfdf69b79-hl469\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") " pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:42.035176 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:42.035137    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-4292v" event={"ID":"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e","Type":"ContainerStarted","Data":"7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc"}
Jul 16 17:44:42.119352 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:42.119286    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:42.283413 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:42.283390    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:42.284928 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:44:42.284895    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75fb1e4_3240_4b16_99d6_36b1b3175a4b.slice/crio-2892de59d2c4b089fe8b22b94fb1614d62cf9cdad3f0a864e082fa33486fb621 WatchSource:0}: Error finding container 2892de59d2c4b089fe8b22b94fb1614d62cf9cdad3f0a864e082fa33486fb621: Status 404 returned error can't find the container with id 2892de59d2c4b089fe8b22b94fb1614d62cf9cdad3f0a864e082fa33486fb621
Jul 16 17:44:43.047386 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:43.047331    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfdf69b79-hl469" event={"ID":"b75fb1e4-3240-4b16-99d6-36b1b3175a4b","Type":"ContainerStarted","Data":"2892de59d2c4b089fe8b22b94fb1614d62cf9cdad3f0a864e082fa33486fb621"}
Jul 16 17:44:44.720566 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:44.720528    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:44.817077 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:44.816990    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:44:45.061383 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:45.061328    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfdf69b79-hl469" event={"ID":"b75fb1e4-3240-4b16-99d6-36b1b3175a4b","Type":"ContainerStarted","Data":"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"}
Jul 16 17:44:45.061595 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:45.061513    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:45.062889 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:45.062865    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-4292v" event={"ID":"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e","Type":"ContainerStarted","Data":"3dc0f409e7330dde7197dd766377edcce70d60f392799f94434f5c9b2453ea54"}
Jul 16 17:44:45.063007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:45.062932    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:45.119518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:45.119465    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bfdf69b79-hl469" podStartSLOduration=1.886592457 podStartE2EDuration="4.119449266s" totalImagesPullingTime="2.232856809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:45.113324841 +0000 UTC m=+709.757547713" watchObservedRunningTime="2026-07-16 17:44:45.119449266 +0000 UTC m=+709.763672144"
Jul 16 17:44:56.070183 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.070157    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:44:56.070626 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.070221    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:56.095356 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.095225    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4d6b9447-4292v" podStartSLOduration=12.35029733 podStartE2EDuration="15.095208549s" totalImagesPullingTime="2.744911219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:44:45.186201376 +0000 UTC m=+709.830424256" watchObservedRunningTime="2026-07-16 17:44:56.095208549 +0000 UTC m=+720.739431428"
Jul 16 17:44:56.151880 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.151853    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:56.152062 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.152043    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-bfdf69b79-hl469" podUID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" containerName="manager" containerID="cri-o://b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c" gracePeriod=30
Jul 16 17:44:56.401420 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.401397    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:56.525265 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.525235    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z55c\" (UniqueName: \"kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c\") pod \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") "
Jul 16 17:44:56.525481 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.525352    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") pod \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\" (UID: \"b75fb1e4-3240-4b16-99d6-36b1b3175a4b\") "
Jul 16 17:44:56.527417 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.527386    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c" (OuterVolumeSpecName: "kube-api-access-4z55c") pod "b75fb1e4-3240-4b16-99d6-36b1b3175a4b" (UID: "b75fb1e4-3240-4b16-99d6-36b1b3175a4b"). InnerVolumeSpecName "kube-api-access-4z55c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:44:56.527541 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.527414    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b75fb1e4-3240-4b16-99d6-36b1b3175a4b" (UID: "b75fb1e4-3240-4b16-99d6-36b1b3175a4b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:44:56.626619 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.626573    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z55c\" (UniqueName: \"kubernetes.io/projected/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-kube-api-access-4z55c\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:56.626619 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:56.626612    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b75fb1e4-3240-4b16-99d6-36b1b3175a4b-webhook-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:44:57.134195 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.134157    2577 generic.go:356] "Generic (PLEG): container finished" podID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" containerID="b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c" exitCode=0
Jul 16 17:44:57.134667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.134210    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bfdf69b79-hl469"
Jul 16 17:44:57.134667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.134238    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfdf69b79-hl469" event={"ID":"b75fb1e4-3240-4b16-99d6-36b1b3175a4b","Type":"ContainerDied","Data":"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"}
Jul 16 17:44:57.134667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.134325    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bfdf69b79-hl469" event={"ID":"b75fb1e4-3240-4b16-99d6-36b1b3175a4b","Type":"ContainerDied","Data":"2892de59d2c4b089fe8b22b94fb1614d62cf9cdad3f0a864e082fa33486fb621"}
Jul 16 17:44:57.134667 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.134348    2577 scope.go:117] "RemoveContainer" containerID="b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"
Jul 16 17:44:57.144101 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.144087    2577 scope.go:117] "RemoveContainer" containerID="b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"
Jul 16 17:44:57.144347 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:44:57.144330    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c\": container with ID starting with b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c not found: ID does not exist" containerID="b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"
Jul 16 17:44:57.144396 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.144354    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c"} err="failed to get container status \"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c\": rpc error: code = NotFound desc = could not find container \"b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c\": container with ID starting with b5845c9ae922d086d6fa3c69cb985e35bae2aad5d927ba1aa3ee26fc884b8f2c not found: ID does not exist"
Jul 16 17:44:57.159378 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.159355    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:57.168971 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.168952    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bfdf69b79-hl469"]
Jul 16 17:44:57.922634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:44:57.922605    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" path="/var/lib/kubelet/pods/b75fb1e4-3240-4b16-99d6-36b1b3175a4b/volumes"
Jul 16 17:45:01.607133 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:01.607102    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:01.708940 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:01.708890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:20.721080 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:20.721040    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:20.819227 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:20.819195    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:21.207878 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.207839    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:21.317787 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.317748    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"]
Jul 16 17:45:21.318129 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.318111    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" containerName="manager"
Jul 16 17:45:21.318180 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.318134    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" containerName="manager"
Jul 16 17:45:21.318214 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.318195    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b75fb1e4-3240-4b16-99d6-36b1b3175a4b" containerName="manager"
Jul 16 17:45:21.321240 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.321224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.324127 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.324102    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 16 17:45:21.324274 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.324133    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-g47r4\""
Jul 16 17:45:21.345274 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.345248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"]
Jul 16 17:45:21.428812 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.428770    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57f6f32-76f8-48fa-bf02-ea10121efbc2-maas-api-tls\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.429007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.428894    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57f6f32-76f8-48fa-bf02-ea10121efbc2-openshift-service-ca\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.429007 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.428946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdl2c\" (UniqueName: \"kubernetes.io/projected/e57f6f32-76f8-48fa-bf02-ea10121efbc2-kube-api-access-pdl2c\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.505223 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.505139    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:21.530404 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.530376    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57f6f32-76f8-48fa-bf02-ea10121efbc2-openshift-service-ca\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.530577 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.530412    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdl2c\" (UniqueName: \"kubernetes.io/projected/e57f6f32-76f8-48fa-bf02-ea10121efbc2-kube-api-access-pdl2c\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.530577 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.530481    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57f6f32-76f8-48fa-bf02-ea10121efbc2-maas-api-tls\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.530987 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.530963    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e57f6f32-76f8-48fa-bf02-ea10121efbc2-openshift-service-ca\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.532822 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.532802    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e57f6f32-76f8-48fa-bf02-ea10121efbc2-maas-api-tls\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.540825 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.540806    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdl2c\" (UniqueName: \"kubernetes.io/projected/e57f6f32-76f8-48fa-bf02-ea10121efbc2-kube-api-access-pdl2c\") pod \"maas-api-66798f8484-ctvtk\" (UID: \"e57f6f32-76f8-48fa-bf02-ea10121efbc2\") " pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.631581 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.631551    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:21.774794 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.774769    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"]
Jul 16 17:45:21.775967 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:45:21.775938    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57f6f32_76f8_48fa_bf02_ea10121efbc2.slice/crio-0af09c47eaafabd5d566a0eb56b859ac8a609ae7dc6c3086fca621f6dec3a83d WatchSource:0}: Error finding container 0af09c47eaafabd5d566a0eb56b859ac8a609ae7dc6c3086fca621f6dec3a83d: Status 404 returned error can't find the container with id 0af09c47eaafabd5d566a0eb56b859ac8a609ae7dc6c3086fca621f6dec3a83d
Jul 16 17:45:21.861376 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.861336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:21.965535 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.965496    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:21.995785 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:21.995753    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2pzp"]
Jul 16 17:45:22.000242 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.000224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.003175 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.003149    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 16 17:45:22.013132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.013108    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2pzp"]
Jul 16 17:45:22.034750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.034682    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e3051be-2d5d-4f26-bcb0-c96158a06303-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.034750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.034712    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv5xj\" (UniqueName: \"kubernetes.io/projected/2e3051be-2d5d-4f26-bcb0-c96158a06303-kube-api-access-qv5xj\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.065108 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.065076    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"]
Jul 16 17:45:22.068637 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.068616    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.071454 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.071434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-fwpg6\""
Jul 16 17:45:22.081095 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.081072    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"]
Jul 16 17:45:22.135597 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.135569    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28h6f\" (UniqueName: \"kubernetes.io/projected/65020f35-c754-47b6-9785-f1e3bd26426c-kube-api-access-28h6f\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.135780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.135607    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e3051be-2d5d-4f26-bcb0-c96158a06303-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.135780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.135630    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv5xj\" (UniqueName: \"kubernetes.io/projected/2e3051be-2d5d-4f26-bcb0-c96158a06303-kube-api-access-qv5xj\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.135780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.135649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65020f35-c754-47b6-9785-f1e3bd26426c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.136257 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.136239    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2e3051be-2d5d-4f26-bcb0-c96158a06303-plugins-config-volume\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.152191 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.152164    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv5xj\" (UniqueName: \"kubernetes.io/projected/2e3051be-2d5d-4f26-bcb0-c96158a06303-kube-api-access-qv5xj\") pod \"payload-processing-5bf47cd988-k2pzp\" (UID: \"2e3051be-2d5d-4f26-bcb0-c96158a06303\") " pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.236945 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.236909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28h6f\" (UniqueName: \"kubernetes.io/projected/65020f35-c754-47b6-9785-f1e3bd26426c-kube-api-access-28h6f\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.237123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.236954    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65020f35-c754-47b6-9785-f1e3bd26426c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.237797 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.237779    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/65020f35-c754-47b6-9785-f1e3bd26426c-plugins-config-volume\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.257664 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.257632    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28h6f\" (UniqueName: \"kubernetes.io/projected/65020f35-c754-47b6-9785-f1e3bd26426c-kube-api-access-28h6f\") pod \"payload-pre-processing-7677b774bb-jrnrx\" (UID: \"65020f35-c754-47b6-9785-f1e3bd26426c\") " pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.279925 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.279893    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk" event={"ID":"e57f6f32-76f8-48fa-bf02-ea10121efbc2","Type":"ContainerStarted","Data":"0af09c47eaafabd5d566a0eb56b859ac8a609ae7dc6c3086fca621f6dec3a83d"}
Jul 16 17:45:22.313116 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.313046    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:22.381307 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.381264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:22.463313 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.463273    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5bf47cd988-k2pzp"]
Jul 16 17:45:22.466449 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:45:22.466421    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3051be_2d5d_4f26_bcb0_c96158a06303.slice/crio-141663a6afe720f219308a88c6fd22fa3875d8cf878d52c7822c6cac19e7e518 WatchSource:0}: Error finding container 141663a6afe720f219308a88c6fd22fa3875d8cf878d52c7822c6cac19e7e518: Status 404 returned error can't find the container with id 141663a6afe720f219308a88c6fd22fa3875d8cf878d52c7822c6cac19e7e518
Jul 16 17:45:22.535115 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:22.535085    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"]
Jul 16 17:45:22.536467 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:45:22.536439    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65020f35_c754_47b6_9785_f1e3bd26426c.slice/crio-8f7d5ae46cefdf08ac45dc85b8be3a753e99b11bd404cd0ef4c2e2f8bb0dc8f2 WatchSource:0}: Error finding container 8f7d5ae46cefdf08ac45dc85b8be3a753e99b11bd404cd0ef4c2e2f8bb0dc8f2: Status 404 returned error can't find the container with id 8f7d5ae46cefdf08ac45dc85b8be3a753e99b11bd404cd0ef4c2e2f8bb0dc8f2
Jul 16 17:45:23.293607 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:23.293567    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx" event={"ID":"65020f35-c754-47b6-9785-f1e3bd26426c","Type":"ContainerStarted","Data":"8f7d5ae46cefdf08ac45dc85b8be3a753e99b11bd404cd0ef4c2e2f8bb0dc8f2"}
Jul 16 17:45:23.296849 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:23.296812    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp" event={"ID":"2e3051be-2d5d-4f26-bcb0-c96158a06303","Type":"ContainerStarted","Data":"141663a6afe720f219308a88c6fd22fa3875d8cf878d52c7822c6cac19e7e518"}
Jul 16 17:45:24.303927 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:24.303891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk" event={"ID":"e57f6f32-76f8-48fa-bf02-ea10121efbc2","Type":"ContainerStarted","Data":"8d01c1a657056af53eca90108350c67833611ab378a11cfc21c09599f129ac1f"}
Jul 16 17:45:24.304372 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:24.304027    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:24.324285 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:24.324230    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk" podStartSLOduration=1.3617398729999999 podStartE2EDuration="3.324211828s" totalImagesPullingTime="1.962471955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:24.322933293 +0000 UTC m=+748.967156171" watchObservedRunningTime="2026-07-16 17:45:24.324211828 +0000 UTC m=+748.968434708"
Jul 16 17:45:25.310908 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:25.310874    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx" event={"ID":"65020f35-c754-47b6-9785-f1e3bd26426c","Type":"ContainerStarted","Data":"cbb7e8ecb7d5099a0cb5bbc039b786c34b5b7a96df3ccc61425c9fe75bc340d4"}
Jul 16 17:45:25.311399 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:25.310941    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:25.312423 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:25.312391    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp" event={"ID":"2e3051be-2d5d-4f26-bcb0-c96158a06303","Type":"ContainerStarted","Data":"bd357ab99cc5bc11688bc5a0cc8a81d9a655325014f194964cdd7c2d61852c0b"}
Jul 16 17:45:25.332420 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:25.332380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx" podStartSLOduration=1.507878507 podStartE2EDuration="3.332366476s" totalImagesPullingTime="1.824487969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:25.330426631 +0000 UTC m=+749.974649511" watchObservedRunningTime="2026-07-16 17:45:25.332366476 +0000 UTC m=+749.976589354"
Jul 16 17:45:25.363307 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:25.352715    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp" podStartSLOduration=2.449645749 podStartE2EDuration="4.352693782s" totalImagesPullingTime="1.903048033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:45:25.351377736 +0000 UTC m=+749.995600616" watchObservedRunningTime="2026-07-16 17:45:25.352693782 +0000 UTC m=+749.996916662"
Jul 16 17:45:26.318334 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:26.318285    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:30.318207 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:30.318175    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-66798f8484-ctvtk"
Jul 16 17:45:31.361080 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:31.361052    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:31.471612 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:31.471579    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:36.320546 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:36.320515    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7677b774bb-jrnrx"
Jul 16 17:45:37.208236 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:37.208199    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:37.325681 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:37.325652    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5bf47cd988-k2pzp"
Jul 16 17:45:37.585599 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:37.585508    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:44.582841 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:44.582803    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:45:54.323910 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:45:54.323871    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:20.548959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:46:20.548875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:29.229783 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:46:29.229749    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:41.463199 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:46:41.463162    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:46:48.352523 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:46:48.352465    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:47:55.835022 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:47:55.834998    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:47:55.835512 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:47:55.835045    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:47:55.838132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:47:55.838114    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:47:55.838256 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:47:55.838225    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:48:04.426041 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.426010    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79fcd99746-dp87t"]
Jul 16 17:48:04.429550 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.429533    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.439680 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.439653    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79fcd99746-dp87t"]
Jul 16 17:48:04.551541 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.551499    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6tlm\" (UniqueName: \"kubernetes.io/projected/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-kube-api-access-p6tlm\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.551750 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.551614    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-tls-cert\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.652668 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.652632    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6tlm\" (UniqueName: \"kubernetes.io/projected/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-kube-api-access-p6tlm\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.652864 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.652699    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-tls-cert\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.655146 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.655117    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-tls-cert\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.663028 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.663004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6tlm\" (UniqueName: \"kubernetes.io/projected/682c6293-12a2-4ea5-8638-c9d7aef0c6e2-kube-api-access-p6tlm\") pod \"authorino-79fcd99746-dp87t\" (UID: \"682c6293-12a2-4ea5-8638-c9d7aef0c6e2\") " pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.740211 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.740130    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fcd99746-dp87t"
Jul 16 17:48:04.747891 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.747864    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:04.847465 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.847427    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:04.892762 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:04.892659    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79fcd99746-dp87t"]
Jul 16 17:48:04.895199 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:48:04.895173    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod682c6293_12a2_4ea5_8638_c9d7aef0c6e2.slice/crio-1e5512f643177176b905bf209c8cc002411703621e63dec1071ec39eb123417c WatchSource:0}: Error finding container 1e5512f643177176b905bf209c8cc002411703621e63dec1071ec39eb123417c: Status 404 returned error can't find the container with id 1e5512f643177176b905bf209c8cc002411703621e63dec1071ec39eb123417c
Jul 16 17:48:05.196651 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:05.196613    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fcd99746-dp87t" event={"ID":"682c6293-12a2-4ea5-8638-c9d7aef0c6e2","Type":"ContainerStarted","Data":"1e5512f643177176b905bf209c8cc002411703621e63dec1071ec39eb123417c"}
Jul 16 17:48:05.956895 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:05.956853    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:06.062116 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.062071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:06.207609 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.207507    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-79fcd99746-dp87t" event={"ID":"682c6293-12a2-4ea5-8638-c9d7aef0c6e2","Type":"ContainerStarted","Data":"2c6de6acbd9a3d10d33ccc39322010889056c46cae9ed9725d11734f6662b3ec"}
Jul 16 17:48:06.233574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.233520    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-79fcd99746-dp87t" podStartSLOduration=1.7874886239999999 podStartE2EDuration="2.233502135s" totalImagesPullingTime="446.013511ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:48:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:48:06.229804237 +0000 UTC m=+910.874027116" watchObservedRunningTime="2026-07-16 17:48:06.233502135 +0000 UTC m=+910.877725014"
Jul 16 17:48:06.274154 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.274115    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:48:06.274396 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.274367    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" podUID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" containerName="authorino" containerID="cri-o://40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868" gracePeriod=30
Jul 16 17:48:06.554793 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.554766    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:48:06.671524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.671493    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert\") pod \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") "
Jul 16 17:48:06.671707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.671616    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwchn\" (UniqueName: \"kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn\") pod \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\" (UID: \"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c\") "
Jul 16 17:48:06.673904 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.673868    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn" (OuterVolumeSpecName: "kube-api-access-lwchn") pod "6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" (UID: "6050b9db-5843-4bb1-baa8-d49bb2f1ff7c"). InnerVolumeSpecName "kube-api-access-lwchn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:48:06.683150 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.683113    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" (UID: "6050b9db-5843-4bb1-baa8-d49bb2f1ff7c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:48:06.772689 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.772646    2577 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-tls-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:48:06.772689 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:06.772680    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwchn\" (UniqueName: \"kubernetes.io/projected/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c-kube-api-access-lwchn\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:48:07.217162 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.217112    2577 generic.go:356] "Generic (PLEG): container finished" podID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" containerID="40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868" exitCode=0
Jul 16 17:48:07.217665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.217185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" event={"ID":"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c","Type":"ContainerDied","Data":"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"}
Jul 16 17:48:07.217665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.217237    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5fbcfc658c-75jqv" event={"ID":"6050b9db-5843-4bb1-baa8-d49bb2f1ff7c","Type":"ContainerDied","Data":"49012ad4ddd5a45753810aba8fdbf2f5d28c572705452792d6fd90585a721841"}
Jul 16 17:48:07.217665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.217258    2577 scope.go:117] "RemoveContainer" containerID="40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"
Jul 16 17:48:07.217665 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.217435    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5fbcfc658c-75jqv"
Jul 16 17:48:07.230369 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.230344    2577 scope.go:117] "RemoveContainer" containerID="40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"
Jul 16 17:48:07.232241 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:48:07.232201    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868\": container with ID starting with 40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868 not found: ID does not exist" containerID="40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"
Jul 16 17:48:07.232386 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.232253    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868"} err="failed to get container status \"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868\": rpc error: code = NotFound desc = could not find container \"40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868\": container with ID starting with 40a4a632bf6da695ac6641bdc3e525df56a10ac9488e8264c379174c217f7868 not found: ID does not exist"
Jul 16 17:48:07.246987 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.246955    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:48:07.250631 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.250602    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5fbcfc658c-75jqv"]
Jul 16 17:48:07.923852 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:07.923821    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" path="/var/lib/kubelet/pods/6050b9db-5843-4bb1-baa8-d49bb2f1ff7c/volumes"
Jul 16 17:48:40.598436 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:40.598396    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:40.701004 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:40.700970    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:48:52.223093 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.223057    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:48:52.223642 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.223258    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d4d6b9447-4292v" podUID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" containerName="manager" containerID="cri-o://3dc0f409e7330dde7197dd766377edcce70d60f392799f94434f5c9b2453ea54" gracePeriod=30
Jul 16 17:48:52.473707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.473647    2577 generic.go:356] "Generic (PLEG): container finished" podID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" containerID="3dc0f409e7330dde7197dd766377edcce70d60f392799f94434f5c9b2453ea54" exitCode=0
Jul 16 17:48:52.473707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.473703    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-4292v" event={"ID":"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e","Type":"ContainerDied","Data":"3dc0f409e7330dde7197dd766377edcce70d60f392799f94434f5c9b2453ea54"}
Jul 16 17:48:52.473853 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.473738    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-4292v" event={"ID":"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e","Type":"ContainerDied","Data":"7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc"}
Jul 16 17:48:52.473853 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.473754    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7beabde715068e0b9c9116557b30e6d7a9cfc451c1cdee54b8cce712c01dccbc"
Jul 16 17:48:52.475198 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.475180    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:48:52.584188 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.584153    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wv8vf\" (UniqueName: \"kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf\") pod \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") "
Jul 16 17:48:52.584377 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.584345    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert\") pod \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\" (UID: \"2c4cc02b-cc22-43aa-b936-e40fb1d3e83e\") "
Jul 16 17:48:52.586324 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.586276    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" (UID: "2c4cc02b-cc22-43aa-b936-e40fb1d3e83e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:48:52.586455 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.586371    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf" (OuterVolumeSpecName: "kube-api-access-wv8vf") pod "2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" (UID: "2c4cc02b-cc22-43aa-b936-e40fb1d3e83e"). InnerVolumeSpecName "kube-api-access-wv8vf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:48:52.685524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.685493    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-webhook-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:48:52.685524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:52.685520    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wv8vf\" (UniqueName: \"kubernetes.io/projected/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e-kube-api-access-wv8vf\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:48:53.479791 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:53.479762    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-4292v"
Jul 16 17:48:53.519863 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:53.519828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:48:53.525430 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:53.525394    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-4292v"]
Jul 16 17:48:53.923433 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:53.923398    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" path="/var/lib/kubelet/pods/2c4cc02b-cc22-43aa-b936-e40fb1d3e83e/volumes"
Jul 16 17:48:57.637034 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:48:57.636996    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:49:07.347803 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:07.347755    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:49:54.413983 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.413944    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:49:54.414518 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414501    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" containerName="manager"
Jul 16 17:49:54.414574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414523    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" containerName="manager"
Jul 16 17:49:54.414574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414537    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" containerName="authorino"
Jul 16 17:49:54.414574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414542    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" containerName="authorino"
Jul 16 17:49:54.414677 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414616    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="6050b9db-5843-4bb1-baa8-d49bb2f1ff7c" containerName="authorino"
Jul 16 17:49:54.414677 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.414626    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c4cc02b-cc22-43aa-b936-e40fb1d3e83e" containerName="manager"
Jul 16 17:49:54.417572 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.417556    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.420166 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.420146    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:49:54.421327 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.421312    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:49:54.421419 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.421400    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tl5dq\""
Jul 16 17:49:54.430385 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.430358    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:49:54.513574 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.513537    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.513757 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.513589    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwn9k\" (UniqueName: \"kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.614477 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.614445    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwn9k\" (UniqueName: \"kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.614691 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.614577    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.617010 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.616985    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.625504 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.625476    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwn9k\" (UniqueName: \"kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k\") pod \"maas-controller-5d4d6b9447-mrvdl\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") " pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.728467 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.728370    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:54.877218 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.877191    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:49:54.878875 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:49:54.878848    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c83d637_e3e2_4cf5_8723_9098141f7012.slice/crio-305aded2c3edc01f5c8777e22049cbc6d7f6d4ee1feb63286cdc149da7c95170 WatchSource:0}: Error finding container 305aded2c3edc01f5c8777e22049cbc6d7f6d4ee1feb63286cdc149da7c95170: Status 404 returned error can't find the container with id 305aded2c3edc01f5c8777e22049cbc6d7f6d4ee1feb63286cdc149da7c95170
Jul 16 17:49:54.880075 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:54.880057    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 17:49:55.841402 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:55.841315    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" event={"ID":"3c83d637-e3e2-4cf5-8723-9098141f7012","Type":"ContainerStarted","Data":"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"}
Jul 16 17:49:55.841402 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:55.841373    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:49:55.841402 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:55.841389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" event={"ID":"3c83d637-e3e2-4cf5-8723-9098141f7012","Type":"ContainerStarted","Data":"305aded2c3edc01f5c8777e22049cbc6d7f6d4ee1feb63286cdc149da7c95170"}
Jul 16 17:49:55.869135 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:49:55.869084    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" podStartSLOduration=1.35674241 podStartE2EDuration="1.86906916s" totalImagesPullingTime="512.32675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:49:55.866242104 +0000 UTC m=+1020.510464984" watchObservedRunningTime="2026-07-16 17:49:55.86906916 +0000 UTC m=+1020.513292038"
Jul 16 17:50:05.405441 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:05.405405    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:06.848769 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:06.848732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:50:11.423378 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.423324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:11.522821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.522765    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:50:11.523085 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.523040    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" podUID="3c83d637-e3e2-4cf5-8723-9098141f7012" containerName="manager" containerID="cri-o://d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1" gracePeriod=30
Jul 16 17:50:11.771912 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.771882    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:50:11.868582 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.868548    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert\") pod \"3c83d637-e3e2-4cf5-8723-9098141f7012\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") "
Jul 16 17:50:11.868770 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.868655    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwn9k\" (UniqueName: \"kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k\") pod \"3c83d637-e3e2-4cf5-8723-9098141f7012\" (UID: \"3c83d637-e3e2-4cf5-8723-9098141f7012\") "
Jul 16 17:50:11.870687 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.870657    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k" (OuterVolumeSpecName: "kube-api-access-hwn9k") pod "3c83d637-e3e2-4cf5-8723-9098141f7012" (UID: "3c83d637-e3e2-4cf5-8723-9098141f7012"). InnerVolumeSpecName "kube-api-access-hwn9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:50:11.870841 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.870665    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3c83d637-e3e2-4cf5-8723-9098141f7012" (UID: "3c83d637-e3e2-4cf5-8723-9098141f7012"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 17:50:11.931987 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.931956    2577 generic.go:356] "Generic (PLEG): container finished" podID="3c83d637-e3e2-4cf5-8723-9098141f7012" containerID="d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1" exitCode=0
Jul 16 17:50:11.932123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.931995    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl"
Jul 16 17:50:11.932123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.932038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" event={"ID":"3c83d637-e3e2-4cf5-8723-9098141f7012","Type":"ContainerDied","Data":"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"}
Jul 16 17:50:11.932123 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.932094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-mrvdl" event={"ID":"3c83d637-e3e2-4cf5-8723-9098141f7012","Type":"ContainerDied","Data":"305aded2c3edc01f5c8777e22049cbc6d7f6d4ee1feb63286cdc149da7c95170"}
Jul 16 17:50:11.932325 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.932124    2577 scope.go:117] "RemoveContainer" containerID="d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"
Jul 16 17:50:11.944184 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.943734    2577 scope.go:117] "RemoveContainer" containerID="d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"
Jul 16 17:50:11.945869 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:50:11.944644    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1\": container with ID starting with d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1 not found: ID does not exist" containerID="d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"
Jul 16 17:50:11.945869 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.945032    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1"} err="failed to get container status \"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1\": rpc error: code = NotFound desc = could not find container \"d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1\": container with ID starting with d75feeb5a397ff53de2a00668a802ae004490f5167aa47544551f7e0c30cffa1 not found: ID does not exist"
Jul 16 17:50:11.955674 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.955642    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:50:11.963345 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.963318    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-mrvdl"]
Jul 16 17:50:11.970184 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.970156    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwn9k\" (UniqueName: \"kubernetes.io/projected/3c83d637-e3e2-4cf5-8723-9098141f7012-kube-api-access-hwn9k\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:50:11.970282 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:11.970187    2577 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3c83d637-e3e2-4cf5-8723-9098141f7012-webhook-cert\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:50:12.681654 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.681618    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:12.789038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.789002    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-k75hb"]
Jul 16 17:50:12.789435 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.789422    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c83d637-e3e2-4cf5-8723-9098141f7012" containerName="manager"
Jul 16 17:50:12.789488 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.789436    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c83d637-e3e2-4cf5-8723-9098141f7012" containerName="manager"
Jul 16 17:50:12.789524 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.789505    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c83d637-e3e2-4cf5-8723-9098141f7012" containerName="manager"
Jul 16 17:50:12.793905 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.793888    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.797042 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.797015    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 16 17:50:12.798239 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.798218    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 16 17:50:12.798380 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.798321    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tl5dq\""
Jul 16 17:50:12.804674 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.804647    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-k75hb"]
Jul 16 17:50:12.878038 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.878006    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ed941b1-6377-429c-953e-b2d83a9b4387-webhook-cert\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.878215 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.878047    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47ghw\" (UniqueName: \"kubernetes.io/projected/8ed941b1-6377-429c-953e-b2d83a9b4387-kube-api-access-47ghw\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.978634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.978557    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ed941b1-6377-429c-953e-b2d83a9b4387-webhook-cert\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.978634 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.978605    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47ghw\" (UniqueName: \"kubernetes.io/projected/8ed941b1-6377-429c-953e-b2d83a9b4387-kube-api-access-47ghw\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.980856 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.980836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ed941b1-6377-429c-953e-b2d83a9b4387-webhook-cert\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:12.989069 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:12.989039    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47ghw\" (UniqueName: \"kubernetes.io/projected/8ed941b1-6377-429c-953e-b2d83a9b4387-kube-api-access-47ghw\") pod \"maas-controller-5d4d6b9447-k75hb\" (UID: \"8ed941b1-6377-429c-953e-b2d83a9b4387\") " pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:13.106216 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.106182    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:13.257194 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.257170    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d4d6b9447-k75hb"]
Jul 16 17:50:13.258701 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:50:13.258674    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed941b1_6377_429c_953e_b2d83a9b4387.slice/crio-a0340d6f9d0c5ecd8040c7403f527d41bcac51e36bc73ad4c95e277d5325e5b4 WatchSource:0}: Error finding container a0340d6f9d0c5ecd8040c7403f527d41bcac51e36bc73ad4c95e277d5325e5b4: Status 404 returned error can't find the container with id a0340d6f9d0c5ecd8040c7403f527d41bcac51e36bc73ad4c95e277d5325e5b4
Jul 16 17:50:13.923824 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.923742    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c83d637-e3e2-4cf5-8723-9098141f7012" path="/var/lib/kubelet/pods/3c83d637-e3e2-4cf5-8723-9098141f7012/volumes"
Jul 16 17:50:13.947654 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.947617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-k75hb" event={"ID":"8ed941b1-6377-429c-953e-b2d83a9b4387","Type":"ContainerStarted","Data":"46b43a85c3c2d97185055f3d8e6fa05c2ae0aebc23d654e1b614c017fb7ba5fc"}
Jul 16 17:50:13.947821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.947672    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:13.947821 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.947696    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d4d6b9447-k75hb" event={"ID":"8ed941b1-6377-429c-953e-b2d83a9b4387","Type":"ContainerStarted","Data":"a0340d6f9d0c5ecd8040c7403f527d41bcac51e36bc73ad4c95e277d5325e5b4"}
Jul 16 17:50:13.973420 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:13.973355    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d4d6b9447-k75hb" podStartSLOduration=1.560385568 podStartE2EDuration="1.973335371s" totalImagesPullingTime="412.949803ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:50:13.9696342 +0000 UTC m=+1038.613857091" watchObservedRunningTime="2026-07-16 17:50:13.973335371 +0000 UTC m=+1038.617558251"
Jul 16 17:50:24.956009 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:24.955979    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d4d6b9447-k75hb"
Jul 16 17:50:48.523763 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:48.523669    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:48.631344 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:48.631283    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:48.762105 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:48.762056    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:55.907682 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:55.907648    2577 scope.go:117] "RemoveContainer" containerID="3dc0f409e7330dde7197dd766377edcce70d60f392799f94434f5c9b2453ea54"
Jul 16 17:50:55.976828 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:55.976799    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:56.087967 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:56.087938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:56.190453 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:56.190360    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:50:56.370428 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:50:56.370395    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:03.361780 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:51:03.361740    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:03.515841 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:51:03.515809    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:23.099496 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:51:23.099458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:51:57.133019 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:51:57.132976    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:52:55.873383 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:52:55.873351    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:52:55.876057 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:52:55.876034    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:52:55.877118 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:52:55.877099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:52:55.879204 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:52:55.879187    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:55:03.894836 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:03.894799    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:55:03.895425 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:03.895111    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" podUID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" containerName="manager" containerID="cri-o://7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df" gracePeriod=10
Jul 16 17:55:06.949372 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:06.949348    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:55:07.043682 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.043602    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume\") pod \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") "
Jul 16 17:55:07.043682 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.043651    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pft86\" (UniqueName: \"kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86\") pod \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\" (UID: \"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc\") "
Jul 16 17:55:07.044012 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.043984    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" (UID: "3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 16 17:55:07.045707 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.045678    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86" (OuterVolumeSpecName: "kube-api-access-pft86") pod "3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" (UID: "3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc"). InnerVolumeSpecName "kube-api-access-pft86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 17:55:07.145021 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.144986    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pft86\" (UniqueName: \"kubernetes.io/projected/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-kube-api-access-pft86\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:55:07.145021 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.145013    2577 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc-extensions-socket-volume\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 17:55:07.595308 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.595253    2577 generic.go:356] "Generic (PLEG): container finished" podID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" containerID="7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df" exitCode=0
Jul 16 17:55:07.595520 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.595322    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"
Jul 16 17:55:07.595520 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.595342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" event={"ID":"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc","Type":"ContainerDied","Data":"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"}
Jul 16 17:55:07.595520 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.595411    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp" event={"ID":"3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc","Type":"ContainerDied","Data":"e42cd239168ced494788db9b601d6f1887d5014142447cc523163808c2017c95"}
Jul 16 17:55:07.595520 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.595445    2577 scope.go:117] "RemoveContainer" containerID="7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"
Jul 16 17:55:07.606568 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.606552    2577 scope.go:117] "RemoveContainer" containerID="7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"
Jul 16 17:55:07.606833 ip-10-0-137-76 kubenswrapper[2577]: E0716 17:55:07.606813    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df\": container with ID starting with 7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df not found: ID does not exist" containerID="7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"
Jul 16 17:55:07.606884 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.606845    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df"} err="failed to get container status \"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df\": rpc error: code = NotFound desc = could not find container \"7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df\": container with ID starting with 7bdbd813f4d2180c0ceb9152b1a9de6652cdab518079d51079e6802bc61a64df not found: ID does not exist"
Jul 16 17:55:07.623539 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.623511    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:55:07.629008 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.628984    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-2pclp"]
Jul 16 17:55:07.922962 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:55:07.922929    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" path="/var/lib/kubelet/pods/3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc/volumes"
Jul 16 17:56:05.169132 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.169097    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"]
Jul 16 17:56:05.169551 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.169479    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" containerName="manager"
Jul 16 17:56:05.169551 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.169489    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" containerName="manager"
Jul 16 17:56:05.169623 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.169555    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3967fb3e-c1b6-4a4a-90f4-5d2fab7dfcdc" containerName="manager"
Jul 16 17:56:05.173690 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.173674    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.176848 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.176828    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s86mb\""
Jul 16 17:56:05.197076 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.197054    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"]
Jul 16 17:56:05.242678 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.242649    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12793fc6-7437-46f3-a2ab-9d6ddace3626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.242809 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.242698    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kk9j\" (UniqueName: \"kubernetes.io/projected/12793fc6-7437-46f3-a2ab-9d6ddace3626-kube-api-access-2kk9j\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.343467 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.343434    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12793fc6-7437-46f3-a2ab-9d6ddace3626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.343632 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.343495    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kk9j\" (UniqueName: \"kubernetes.io/projected/12793fc6-7437-46f3-a2ab-9d6ddace3626-kube-api-access-2kk9j\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.343791 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.343770    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/12793fc6-7437-46f3-a2ab-9d6ddace3626-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.358925 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.358901    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kk9j\" (UniqueName: \"kubernetes.io/projected/12793fc6-7437-46f3-a2ab-9d6ddace3626-kube-api-access-2kk9j\") pod \"kuadrant-operator-controller-manager-86878c769f-twmc6\" (UID: \"12793fc6-7437-46f3-a2ab-9d6ddace3626\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.483882 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.483802    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.624414 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.624386    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"]
Jul 16 17:56:05.625187 ip-10-0-137-76 kubenswrapper[2577]: W0716 17:56:05.625164    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12793fc6_7437_46f3_a2ab_9d6ddace3626.slice/crio-f902781c49faf41af60961f5d3cb446220f8e6e68bbee06f85df4d09c4f43709 WatchSource:0}: Error finding container f902781c49faf41af60961f5d3cb446220f8e6e68bbee06f85df4d09c4f43709: Status 404 returned error can't find the container with id f902781c49faf41af60961f5d3cb446220f8e6e68bbee06f85df4d09c4f43709
Jul 16 17:56:05.912999 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.912965    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6" event={"ID":"12793fc6-7437-46f3-a2ab-9d6ddace3626","Type":"ContainerStarted","Data":"3b9f10a30a86d13d02d5d5b7913531174d39d2718ce456da5fc668461b354939"}
Jul 16 17:56:05.913164 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.913026    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6" event={"ID":"12793fc6-7437-46f3-a2ab-9d6ddace3626","Type":"ContainerStarted","Data":"f902781c49faf41af60961f5d3cb446220f8e6e68bbee06f85df4d09c4f43709"}
Jul 16 17:56:05.913164 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.913140    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:56:05.947461 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:05.947405    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6" podStartSLOduration=0.947385229 podStartE2EDuration="947.385229ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 17:56:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 17:56:05.945584509 +0000 UTC m=+1390.589807387" watchObservedRunningTime="2026-07-16 17:56:05.947385229 +0000 UTC m=+1390.591608111"
Jul 16 17:56:16.922955 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:56:16.922926    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twmc6"
Jul 16 17:57:26.001959 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:26.001880    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:27.540594 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:27.540562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:57:55.919241 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:55.919213    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:57:55.929111 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:55.926373    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:57:55.930146 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:55.930115    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 17:57:55.933391 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:57:55.933373    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 17:58:45.139130 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:58:45.139099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:07.157899 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:59:07.157870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 17:59:45.646606 ip-10-0-137-76 kubenswrapper[2577]: I0716 17:59:45.646574    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:00:00.164800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.164709    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"]
Jul 16 18:00:00.168162 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.168139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"
Jul 16 18:00:00.171261 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.171233    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:00:00.178171 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.178155    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"
Jul 16 18:00:00.188463 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.188436    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"]
Jul 16 18:00:00.535723 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.535695    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"]
Jul 16 18:00:00.537353 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:00:00.537329    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f17aa82_2563_40f1_80ed_b2a085a71e97.slice/crio-83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366 WatchSource:0}: Error finding container 83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366: Status 404 returned error can't find the container with id 83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366
Jul 16 18:00:00.539828 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:00.539808    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:00:01.264113 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:01.264079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm" event={"ID":"2f17aa82-2563-40f1-80ed-b2a085a71e97","Type":"ContainerStarted","Data":"83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366"}
Jul 16 18:00:19.371915 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:19.371881    2577 generic.go:356] "Generic (PLEG): container finished" podID="2f17aa82-2563-40f1-80ed-b2a085a71e97" containerID="20b182482637b0bdb3c6407ec13d88324007a41bb49cbc6b5a0a40d71cde71ed" exitCode=0
Jul 16 18:00:19.372350 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:19.371920    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm" event={"ID":"2f17aa82-2563-40f1-80ed-b2a085a71e97","Type":"ContainerDied","Data":"20b182482637b0bdb3c6407ec13d88324007a41bb49cbc6b5a0a40d71cde71ed"}
Jul 16 18:00:20.524758 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:20.524736    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"
Jul 16 18:00:21.384335 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:21.384305    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm"
Jul 16 18:00:21.384510 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:21.384342    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737080-tlhxm" event={"ID":"2f17aa82-2563-40f1-80ed-b2a085a71e97","Type":"ContainerDied","Data":"83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366"}
Jul 16 18:00:21.384510 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:00:21.384422    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="83c6ff1ed73b6f98ec7e8ac512018fecd31ee27d90e1977f5c77b0fc2be68366"
Jul 16 18:02:01.708125 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:01.708077    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:09.211583 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:09.211538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:17.528057 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:17.528024    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:22.803459 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:22.803424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:26.209454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:26.209424    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:26.304301 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:26.304256    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:26.798332 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:26.798277    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:33.736160 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:33.736127    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:35.192940 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.192870    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:35.301666 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.301632    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:35.301936 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.301916    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:02:35.302390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.302373    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f17aa82-2563-40f1-80ed-b2a085a71e97" containerName="cleanup"
Jul 16 18:02:35.302390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.302392    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f17aa82-2563-40f1-80ed-b2a085a71e97" containerName="cleanup"
Jul 16 18:02:35.302535 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.302525    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f17aa82-2563-40f1-80ed-b2a085a71e97" containerName="cleanup"
Jul 16 18:02:35.305725 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.305706    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.308260 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.308238    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f06db564-serving-cert\""
Jul 16 18:02:35.316908 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.316884    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:02:35.397046 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.397011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:35.401215 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.401193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69wpm\" (UniqueName: \"kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.401319 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.401254    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.401417 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.401400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.502817 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.502722    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.502817 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.502764    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69wpm\" (UniqueName: \"kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.502817 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.502812    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.503468 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.503446    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.505217 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.505196    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.512616 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.512585    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69wpm\" (UniqueName: \"kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm\") pod \"maas-api-e2e-ait-f06db564-6bd48555dd-h89pj\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.545977 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.545950    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:35.617396 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.617369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:35.763894 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.763857    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:02:35.765060 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:02:35.765034    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c040a5_ee0c_4d60_b4ef_6b9ef1a0a317.slice/crio-0dd0902f939dfcb85661433cc11aa009e6d6b7f92a445e963ade29c6b0d805d3 WatchSource:0}: Error finding container 0dd0902f939dfcb85661433cc11aa009e6d6b7f92a445e963ade29c6b0d805d3: Status 404 returned error can't find the container with id 0dd0902f939dfcb85661433cc11aa009e6d6b7f92a445e963ade29c6b0d805d3
Jul 16 18:02:35.904500 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:35.904471    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:36.006153 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:36.006117    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:36.139360 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:36.139324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" event={"ID":"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317","Type":"ContainerStarted","Data":"0dd0902f939dfcb85661433cc11aa009e6d6b7f92a445e963ade29c6b0d805d3"}
Jul 16 18:02:37.146424 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:37.146389    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" event={"ID":"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317","Type":"ContainerStarted","Data":"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"}
Jul 16 18:02:37.146824 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:37.146457    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:37.178713 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:37.178667    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" podStartSLOduration=1.553418351 podStartE2EDuration="2.178651331s" totalImagesPullingTime="625.23298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:02:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:02:37.1782464 +0000 UTC m=+1781.822469280" watchObservedRunningTime="2026-07-16 18:02:37.178651331 +0000 UTC m=+1781.822874239"
Jul 16 18:02:37.879003 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:37.878975    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:02:40.415121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.415090    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:02:40.418775 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.418759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:02:40.422733 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.422716    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:02:40.437132 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.437109    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:02:40.551036 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.545494    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-lljld\" (UID: \"e0f5e4a9-e6e9-47ec-ac62-aec75176582a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:02:40.646927 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.646894    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-lljld\" (UID: \"e0f5e4a9-e6e9-47ec-ac62-aec75176582a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:02:40.647577 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.647558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-lljld\" (UID: \"e0f5e4a9-e6e9-47ec-ac62-aec75176582a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:02:40.730041 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.729941    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:02:40.873168 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:40.873139    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:02:40.874725 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:02:40.874697    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f5e4a9_e6e9_47ec_ac62_aec75176582a.slice/crio-cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8 WatchSource:0}: Error finding container cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8: Status 404 returned error can't find the container with id cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8
Jul 16 18:02:41.174629 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:41.174520    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerStarted","Data":"5f57c8f8d389e42858e41fff8572805df51e36a8b581218c08c884831b6ef3ad"}
Jul 16 18:02:41.174961 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:41.174930    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerStarted","Data":"cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8"}
Jul 16 18:02:41.208434 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:41.208380    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" podStartSLOduration=1.208361117 podStartE2EDuration="1.208361117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:02:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:02:41.206734867 +0000 UTC m=+1785.850957747" watchObservedRunningTime="2026-07-16 18:02:41.208361117 +0000 UTC m=+1785.852583996"
Jul 16 18:02:42.182056 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:42.182025    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerID="5f57c8f8d389e42858e41fff8572805df51e36a8b581218c08c884831b6ef3ad" exitCode=7
Jul 16 18:02:42.182479 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:42.182111    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerDied","Data":"5f57c8f8d389e42858e41fff8572805df51e36a8b581218c08c884831b6ef3ad"}
Jul 16 18:02:42.182479 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:42.182282    2577 scope.go:117] "RemoveContainer" containerID="5f57c8f8d389e42858e41fff8572805df51e36a8b581218c08c884831b6ef3ad"
Jul 16 18:02:43.157876 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:43.157839    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:02:43.190482 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:43.190446    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerID="6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4" exitCode=7
Jul 16 18:02:43.190955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:43.190526    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerDied","Data":"6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4"}
Jul 16 18:02:43.190955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:43.190584    2577 scope.go:117] "RemoveContainer" containerID="5f57c8f8d389e42858e41fff8572805df51e36a8b581218c08c884831b6ef3ad"
Jul 16 18:02:43.190955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:43.190820    2577 scope.go:117] "RemoveContainer" containerID="6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4"
Jul 16 18:02:43.191125 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:02:43.191048    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f06db564-lljld_odh-ai-gateway-infra(e0f5e4a9-e6e9-47ec-ac62-aec75176582a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a"
Jul 16 18:02:44.197683 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:44.197651    2577 scope.go:117] "RemoveContainer" containerID="6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4"
Jul 16 18:02:44.198160 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:02:44.197877    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-f06db564-lljld_odh-ai-gateway-infra(e0f5e4a9-e6e9-47ec-ac62-aec75176582a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a"
Jul 16 18:02:55.963441 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:55.963413    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:02:55.966504 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:55.966483    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:02:55.970940 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:55.970917    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:02:55.973573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:55.973559    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:02:57.917249 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:57.917216    2577 scope.go:117] "RemoveContainer" containerID="6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4"
Jul 16 18:02:58.277191 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:58.277165    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerStarted","Data":"d7e0001436154154db3819d2923de1b73d741a20a24bd0812c59c1dbf3b9978b"}
Jul 16 18:02:59.284071 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:59.284041    2577 generic.go:356] "Generic (PLEG): container finished" podID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerID="d7e0001436154154db3819d2923de1b73d741a20a24bd0812c59c1dbf3b9978b" exitCode=0
Jul 16 18:02:59.284488 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:59.284094    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerDied","Data":"d7e0001436154154db3819d2923de1b73d741a20a24bd0812c59c1dbf3b9978b"}
Jul 16 18:02:59.284488 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:59.284144    2577 scope.go:117] "RemoveContainer" containerID="6820b138b4307c1c2f52838b896f4605fbdc073b442814b1ea7fbec5e223a9e4"
Jul 16 18:02:59.311337 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:02:59.311310    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:03:00.428062 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:00.428039    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:03:00.430945 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:00.430926    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca\") pod \"e0f5e4a9-e6e9-47ec-ac62-aec75176582a\" (UID: \"e0f5e4a9-e6e9-47ec-ac62-aec75176582a\") "
Jul 16 18:03:00.431241 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:00.431220    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0f5e4a9-e6e9-47ec-ac62-aec75176582a" (UID: "e0f5e4a9-e6e9-47ec-ac62-aec75176582a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:03:00.532207 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:00.532172    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f5e4a9-e6e9-47ec-ac62-aec75176582a-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:03:01.298975 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.298949    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"
Jul 16 18:03:01.298975 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.298958    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld" event={"ID":"e0f5e4a9-e6e9-47ec-ac62-aec75176582a","Type":"ContainerDied","Data":"cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8"}
Jul 16 18:03:01.299210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.299009    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb021f2d3ed0880073ff88d2ed931d3767b6ea006dd0ea0ce4306a0fe5e7ada8"
Jul 16 18:03:01.335476 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.335448    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:03:01.341457 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.341421    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-lljld"]
Jul 16 18:03:01.922368 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:01.922338    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" path="/var/lib/kubelet/pods/e0f5e4a9-e6e9-47ec-ac62-aec75176582a/volumes"
Jul 16 18:03:36.038093 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:36.038057    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:36.136078 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:36.136044    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:40.478156 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478115    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"]
Jul 16 18:03:40.478622 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478567    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.478622 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478582    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.478622 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478606    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.478622 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478615    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.478758 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478700    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.478758 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.478709    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:03:40.480939 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.480919    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:40.483670 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.483648    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:03:40.491943 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.491917    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"]
Jul 16 18:03:40.586003 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.585972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-ctfbz\" (UID: \"010eb519-f527-40c5-a0ec-54aa87889b7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:40.687476 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.687439    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-ctfbz\" (UID: \"010eb519-f527-40c5-a0ec-54aa87889b7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:40.688056 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.688035    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-f06db564-ctfbz\" (UID: \"010eb519-f527-40c5-a0ec-54aa87889b7d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:40.791824 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.791730    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:40.924695 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:40.924443    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"]
Jul 16 18:03:40.926977 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:03:40.926951    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod010eb519_f527_40c5_a0ec_54aa87889b7d.slice/crio-dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d WatchSource:0}: Error finding container dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d: Status 404 returned error can't find the container with id dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d
Jul 16 18:03:41.520424 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:41.520324    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz" event={"ID":"010eb519-f527-40c5-a0ec-54aa87889b7d","Type":"ContainerStarted","Data":"5001fa0ccce9cbac6704aff777efec4484421ecf98db54c7bcc7e20fce682e92"}
Jul 16 18:03:41.520424 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:41.520419    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz" event={"ID":"010eb519-f527-40c5-a0ec-54aa87889b7d","Type":"ContainerStarted","Data":"dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d"}
Jul 16 18:03:41.540257 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:41.540205    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz" podStartSLOduration=1.540191103 podStartE2EDuration="1.540191103s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:03:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:03:41.537637896 +0000 UTC m=+1846.181860775" watchObservedRunningTime="2026-07-16 18:03:41.540191103 +0000 UTC m=+1846.184413982"
Jul 16 18:03:42.527661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:42.527624    2577 generic.go:356] "Generic (PLEG): container finished" podID="010eb519-f527-40c5-a0ec-54aa87889b7d" containerID="5001fa0ccce9cbac6704aff777efec4484421ecf98db54c7bcc7e20fce682e92" exitCode=0
Jul 16 18:03:42.528049 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:42.527708    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz" event={"ID":"010eb519-f527-40c5-a0ec-54aa87889b7d","Type":"ContainerDied","Data":"5001fa0ccce9cbac6704aff777efec4484421ecf98db54c7bcc7e20fce682e92"}
Jul 16 18:03:43.667268 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:43.667247    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:43.815983 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:43.815893    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca\") pod \"010eb519-f527-40c5-a0ec-54aa87889b7d\" (UID: \"010eb519-f527-40c5-a0ec-54aa87889b7d\") "
Jul 16 18:03:43.816240 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:43.816217    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "010eb519-f527-40c5-a0ec-54aa87889b7d" (UID: "010eb519-f527-40c5-a0ec-54aa87889b7d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:03:43.916875 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:43.916842    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/010eb519-f527-40c5-a0ec-54aa87889b7d-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:03:44.539721 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:44.539689    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz"
Jul 16 18:03:44.539941 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:44.539728    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-f06db564-ctfbz" event={"ID":"010eb519-f527-40c5-a0ec-54aa87889b7d","Type":"ContainerDied","Data":"dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d"}
Jul 16 18:03:44.539941 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:44.539773    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd6809934e258d7feef1c8f2c001a42835d6af943b9f17155c0db57f531eac5d"
Jul 16 18:03:50.520604 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.520566    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:03:50.521137 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.520845    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" podUID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" containerName="maas-api" containerID="cri-o://5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a" gracePeriod=30
Jul 16 18:03:50.545359 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.545328    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:50.774884 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.774823    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:03:50.872837 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.872801    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls\") pod \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") "
Jul 16 18:03:50.873045 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.872872    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca\") pod \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") "
Jul 16 18:03:50.873045 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.872922    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69wpm\" (UniqueName: \"kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm\") pod \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\" (UID: \"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317\") "
Jul 16 18:03:50.873202 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.873176    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" (UID: "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:03:50.875105 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.875075    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm" (OuterVolumeSpecName: "kube-api-access-69wpm") pod "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" (UID: "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317"). InnerVolumeSpecName "kube-api-access-69wpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:03:50.875212 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.875143    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" (UID: "f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:03:50.974464 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.974433    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:03:50.974464 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.974458    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69wpm\" (UniqueName: \"kubernetes.io/projected/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-kube-api-access-69wpm\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:03:50.974464 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:50.974468    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:03:51.579727 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.579685    2577 generic.go:356] "Generic (PLEG): container finished" podID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" containerID="5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a" exitCode=0
Jul 16 18:03:51.580150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.579741    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"
Jul 16 18:03:51.580150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.579772    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" event={"ID":"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317","Type":"ContainerDied","Data":"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"}
Jul 16 18:03:51.580150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.579852    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj" event={"ID":"f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317","Type":"ContainerDied","Data":"0dd0902f939dfcb85661433cc11aa009e6d6b7f92a445e963ade29c6b0d805d3"}
Jul 16 18:03:51.580150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.579877    2577 scope.go:117] "RemoveContainer" containerID="5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"
Jul 16 18:03:51.589729 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.589711    2577 scope.go:117] "RemoveContainer" containerID="5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"
Jul 16 18:03:51.589987 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:03:51.589969    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a\": container with ID starting with 5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a not found: ID does not exist" containerID="5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"
Jul 16 18:03:51.590069 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.589993    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a"} err="failed to get container status \"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a\": rpc error: code = NotFound desc = could not find container \"5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a\": container with ID starting with 5384261fc9f601874d5ce084462572dfa86918ca1ea12bc43f15d6d5bfe6685a not found: ID does not exist"
Jul 16 18:03:51.603568 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.603543    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:03:51.607934 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.607914    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f06db564-6bd48555dd-h89pj"]
Jul 16 18:03:51.923309 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:51.923262    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" path="/var/lib/kubelet/pods/f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317/volumes"
Jul 16 18:03:55.717750 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:55.717711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:55.920265 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:55.920231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:03:56.057988 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:03:56.057937    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:02.610470 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:02.610435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:02.708268 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:02.708240    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:02.899093 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:02.899060    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:02.997126 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:02.997099    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:03.094024 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:03.093993    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:04.412139 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.412105    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:04.493040 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493002    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:04:04.493654 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493605    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="010eb519-f527-40c5-a0ec-54aa87889b7d" containerName="revoke-keys"
Jul 16 18:04:04.493719 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493660    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="010eb519-f527-40c5-a0ec-54aa87889b7d" containerName="revoke-keys"
Jul 16 18:04:04.493719 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493686    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:04:04.493719 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493697    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:04:04.493817 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493723    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" containerName="maas-api"
Jul 16 18:04:04.493817 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493732    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" containerName="maas-api"
Jul 16 18:04:04.493877 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493847    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8c040a5-ee0c-4d60-b4ef-6b9ef1a0a317" containerName="maas-api"
Jul 16 18:04:04.493877 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493860    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="010eb519-f527-40c5-a0ec-54aa87889b7d" containerName="revoke-keys"
Jul 16 18:04:04.493938 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.493897    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f5e4a9-e6e9-47ec-ac62-aec75176582a" containerName="revoke-keys"
Jul 16 18:04:04.496818 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.496799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.499274 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.499253    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-89f0be1f-serving-cert\""
Jul 16 18:04:04.509493 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.509472    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:04:04.538577 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.538548    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:04.585391 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.585357    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.585584 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.585409    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k45qk\" (UniqueName: \"kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.585584 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.585496    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.686011 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.685923    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.686011 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.686000    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.686216 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.686036    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k45qk\" (UniqueName: \"kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.686216 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:04:04.686082    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-serving-cert: secret "maas-api-e2e-migrate-89f0be1f-serving-cert" not found
Jul 16 18:04:04.686216 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:04:04.686162    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls podName:aff5e66a-a245-4176-bfa1-da222b2c6cbb nodeName:}" failed. No retries permitted until 2026-07-16 18:04:05.186141547 +0000 UTC m=+1869.830364408 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls") pod "maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" (UID: "aff5e66a-a245-4176-bfa1-da222b2c6cbb") : secret "maas-api-e2e-migrate-89f0be1f-serving-cert" not found
Jul 16 18:04:04.686658 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.686640    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.695682 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.695655    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k45qk\" (UniqueName: \"kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:04.842492 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:04.842460    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.062855 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.062757    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.165575 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.165545    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:05.189426 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.189391    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:05.191745 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.191707    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") pod \"maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:05.412351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.412282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:05.553279 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.553248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:04:05.555891 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:04:05.555858    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff5e66a_a245_4176_bfa1_da222b2c6cbb.slice/crio-3bd7e8ccbb69c9d53f4b3856da626d15019c19eaceb27cc2fbf30f34a9d754b1 WatchSource:0}: Error finding container 3bd7e8ccbb69c9d53f4b3856da626d15019c19eaceb27cc2fbf30f34a9d754b1: Status 404 returned error can't find the container with id 3bd7e8ccbb69c9d53f4b3856da626d15019c19eaceb27cc2fbf30f34a9d754b1
Jul 16 18:04:05.663217 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:05.663133    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" event={"ID":"aff5e66a-a245-4176-bfa1-da222b2c6cbb","Type":"ContainerStarted","Data":"3bd7e8ccbb69c9d53f4b3856da626d15019c19eaceb27cc2fbf30f34a9d754b1"}
Jul 16 18:04:06.670389 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:06.670357    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" event={"ID":"aff5e66a-a245-4176-bfa1-da222b2c6cbb","Type":"ContainerStarted","Data":"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"}
Jul 16 18:04:06.670785 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:06.670501    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:06.692751 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:06.692696    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" podStartSLOduration=2.151379837 podStartE2EDuration="2.692678204s" totalImagesPullingTime="541.298367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:04:06.69061025 +0000 UTC m=+1871.334833128" watchObservedRunningTime="2026-07-16 18:04:06.692678204 +0000 UTC m=+1871.336901083"
Jul 16 18:04:07.682414 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:07.682387    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:07.788588 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:07.788557    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:08.957471 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:08.957433    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:08.961061 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:08.961041    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:08.963698 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:08.963674    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:04:08.970346 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:08.970320    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:09.023228 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.023191    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r\" (UID: \"f56e5468-1583-4a82-b25e-e297096a31f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:09.124592 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.124552    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r\" (UID: \"f56e5468-1583-4a82-b25e-e297096a31f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:09.125187 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.125167    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r\" (UID: \"f56e5468-1583-4a82-b25e-e297096a31f7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:09.273109 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.273018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:09.413879 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.413854    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:09.415502 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:04:09.415476    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf56e5468_1583_4a82_b25e_e297096a31f7.slice/crio-9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700 WatchSource:0}: Error finding container 9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700: Status 404 returned error can't find the container with id 9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700
Jul 16 18:04:09.689306 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:09.689260    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" event={"ID":"f56e5468-1583-4a82-b25e-e297096a31f7","Type":"ContainerStarted","Data":"9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700"}
Jul 16 18:04:10.696194 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:10.696160    2577 generic.go:356] "Generic (PLEG): container finished" podID="f56e5468-1583-4a82-b25e-e297096a31f7" containerID="05e21424ec6759fbcd18a2e6689bda91e653c9debffef2a0237667d089d39dbd" exitCode=7
Jul 16 18:04:10.696603 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:10.696249    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" event={"ID":"f56e5468-1583-4a82-b25e-e297096a31f7","Type":"ContainerDied","Data":"05e21424ec6759fbcd18a2e6689bda91e653c9debffef2a0237667d089d39dbd"}
Jul 16 18:04:10.696603 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:10.696419    2577 scope.go:117] "RemoveContainer" containerID="05e21424ec6759fbcd18a2e6689bda91e653c9debffef2a0237667d089d39dbd"
Jul 16 18:04:11.009936 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:11.009890    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:04:11.703159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:11.703127    2577 generic.go:356] "Generic (PLEG): container finished" podID="f56e5468-1583-4a82-b25e-e297096a31f7" containerID="ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906" exitCode=7
Jul 16 18:04:11.703596 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:11.703206    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" event={"ID":"f56e5468-1583-4a82-b25e-e297096a31f7","Type":"ContainerDied","Data":"ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906"}
Jul 16 18:04:11.703596 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:11.703262    2577 scope.go:117] "RemoveContainer" containerID="05e21424ec6759fbcd18a2e6689bda91e653c9debffef2a0237667d089d39dbd"
Jul 16 18:04:11.703596 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:11.703472    2577 scope.go:117] "RemoveContainer" containerID="ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906"
Jul 16 18:04:11.703741 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:04:11.703703    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r_odh-ai-gateway-infra(f56e5468-1583-4a82-b25e-e297096a31f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" podUID="f56e5468-1583-4a82-b25e-e297096a31f7"
Jul 16 18:04:12.681901 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:12.681874    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:04:12.710618 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:12.710596    2577 scope.go:117] "RemoveContainer" containerID="ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906"
Jul 16 18:04:12.711041 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:04:12.710796    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r_odh-ai-gateway-infra(f56e5468-1583-4a82-b25e-e297096a31f7)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" podUID="f56e5468-1583-4a82-b25e-e297096a31f7"
Jul 16 18:04:22.917786 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:22.917701    2577 scope.go:117] "RemoveContainer" containerID="ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906"
Jul 16 18:04:23.774434 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:23.774401    2577 generic.go:356] "Generic (PLEG): container finished" podID="f56e5468-1583-4a82-b25e-e297096a31f7" containerID="bc6d6b34cd215acc80a7d966cdb8069cbb4628880e1cdc2c923f647652f8458f" exitCode=0
Jul 16 18:04:23.774599 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:23.774474    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" event={"ID":"f56e5468-1583-4a82-b25e-e297096a31f7","Type":"ContainerDied","Data":"bc6d6b34cd215acc80a7d966cdb8069cbb4628880e1cdc2c923f647652f8458f"}
Jul 16 18:04:23.774599 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:23.774534    2577 scope.go:117] "RemoveContainer" containerID="ade34496d5c280edc6b00e2b74ccdc4ebde87a35b0e6664a3dcda3c61bd2f906"
Jul 16 18:04:24.815513 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:24.815478    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:24.926775 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:24.926750    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:25.066015 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.065930    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca\") pod \"f56e5468-1583-4a82-b25e-e297096a31f7\" (UID: \"f56e5468-1583-4a82-b25e-e297096a31f7\") "
Jul 16 18:04:25.066285 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.066263    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f56e5468-1583-4a82-b25e-e297096a31f7" (UID: "f56e5468-1583-4a82-b25e-e297096a31f7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:04:25.166756 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.166725    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f56e5468-1583-4a82-b25e-e297096a31f7-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:04:25.787665 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.787627    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r" event={"ID":"f56e5468-1583-4a82-b25e-e297096a31f7","Type":"ContainerDied","Data":"9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700"}
Jul 16 18:04:25.787840 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.787675    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f538fb604fe49eee0394996e2bbee21af10572be6bd9414c2453ff698ca1700"
Jul 16 18:04:25.787840 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.787642    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"
Jul 16 18:04:25.825775 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.825743    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:25.828030 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.828010    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-kd64r"]
Jul 16 18:04:25.923401 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:25.923372    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" path="/var/lib/kubelet/pods/f56e5468-1583-4a82-b25e-e297096a31f7/volumes"
Jul 16 18:04:59.041005 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.040970    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"]
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041558    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041575    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041587    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041594    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041607    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041613    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041682    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041689    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.043390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.041697    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f56e5468-1583-4a82-b25e-e297096a31f7" containerName="revoke-keys"
Jul 16 18:04:59.044524 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.044504    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:04:59.047718 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.047690    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:04:59.057282 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.057249    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"]
Jul 16 18:04:59.065641 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.065616    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx\" (UID: \"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:04:59.166478 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.166441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx\" (UID: \"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:04:59.167080 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.167062    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx\" (UID: \"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:04:59.356119 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.356032    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:04:59.501749 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.501723    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"]
Jul 16 18:04:59.503918 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:04:59.503886    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14942ac9_bdf7_4eb7_ad72_d03ba1c79c23.slice/crio-bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a WatchSource:0}: Error finding container bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a: Status 404 returned error can't find the container with id bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a
Jul 16 18:04:59.984306 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.984185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx" event={"ID":"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23","Type":"ContainerStarted","Data":"7174d4c7cace1b1f6875b93aaa9f7177613472de67bc43933800abedded54d7a"}
Jul 16 18:04:59.984306 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:04:59.984243    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx" event={"ID":"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23","Type":"ContainerStarted","Data":"bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a"}
Jul 16 18:05:00.004193 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:00.004143    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx" podStartSLOduration=1.004125278 podStartE2EDuration="1.004125278s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:04:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:00.003813839 +0000 UTC m=+1924.648036718" watchObservedRunningTime="2026-07-16 18:05:00.004125278 +0000 UTC m=+1924.648348158"
Jul 16 18:05:00.992683 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:00.992653    2577 generic.go:356] "Generic (PLEG): container finished" podID="14942ac9-bdf7-4eb7-ad72-d03ba1c79c23" containerID="7174d4c7cace1b1f6875b93aaa9f7177613472de67bc43933800abedded54d7a" exitCode=0
Jul 16 18:05:00.993069 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:00.992742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx" event={"ID":"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23","Type":"ContainerDied","Data":"7174d4c7cace1b1f6875b93aaa9f7177613472de67bc43933800abedded54d7a"}
Jul 16 18:05:02.155389 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:02.155365    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:05:02.290575 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:02.290486    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca\") pod \"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23\" (UID: \"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23\") "
Jul 16 18:05:02.290833 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:02.290810    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "14942ac9-bdf7-4eb7-ad72-d03ba1c79c23" (UID: "14942ac9-bdf7-4eb7-ad72-d03ba1c79c23"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:05:02.391628 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:02.391597    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/14942ac9-bdf7-4eb7-ad72-d03ba1c79c23-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:05:03.005784 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:03.005758    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx"
Jul 16 18:05:03.005960 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:03.005799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx" event={"ID":"14942ac9-bdf7-4eb7-ad72-d03ba1c79c23","Type":"ContainerDied","Data":"bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a"}
Jul 16 18:05:03.005960 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:03.005847    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf95c20b08684bbbfbbc75a57ede42ebfb0f20f5552584d535c6d27aca64e35a"
Jul 16 18:05:09.109102 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.109067    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:05:09.109586 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.109350    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" podUID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" containerName="maas-api" containerID="cri-o://9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890" gracePeriod=30
Jul 16 18:05:09.120550 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.120526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:09.196706 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.196678    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:09.306112 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.306076    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:09.370066 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.370047    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:05:09.446758 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.446729    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca\") pod \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") "
Jul 16 18:05:09.446955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.446792    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k45qk\" (UniqueName: \"kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk\") pod \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") "
Jul 16 18:05:09.446955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.446839    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") pod \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\" (UID: \"aff5e66a-a245-4176-bfa1-da222b2c6cbb\") "
Jul 16 18:05:09.447174 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.447150    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aff5e66a-a245-4176-bfa1-da222b2c6cbb" (UID: "aff5e66a-a245-4176-bfa1-da222b2c6cbb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:05:09.448893 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.448868    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aff5e66a-a245-4176-bfa1-da222b2c6cbb" (UID: "aff5e66a-a245-4176-bfa1-da222b2c6cbb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:05:09.448989 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.448970    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk" (OuterVolumeSpecName: "kube-api-access-k45qk") pod "aff5e66a-a245-4176-bfa1-da222b2c6cbb" (UID: "aff5e66a-a245-4176-bfa1-da222b2c6cbb"). InnerVolumeSpecName "kube-api-access-k45qk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:05:09.548366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.548332    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k45qk\" (UniqueName: \"kubernetes.io/projected/aff5e66a-a245-4176-bfa1-da222b2c6cbb-kube-api-access-k45qk\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:05:09.548366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.548363    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aff5e66a-a245-4176-bfa1-da222b2c6cbb-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:05:09.548572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:09.548377    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aff5e66a-a245-4176-bfa1-da222b2c6cbb-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:05:10.045948 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.045909    2577 generic.go:356] "Generic (PLEG): container finished" podID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" containerID="9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890" exitCode=0
Jul 16 18:05:10.046121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.045959    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"
Jul 16 18:05:10.046121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.045987    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" event={"ID":"aff5e66a-a245-4176-bfa1-da222b2c6cbb","Type":"ContainerDied","Data":"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"}
Jul 16 18:05:10.046121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.046038    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds" event={"ID":"aff5e66a-a245-4176-bfa1-da222b2c6cbb","Type":"ContainerDied","Data":"3bd7e8ccbb69c9d53f4b3856da626d15019c19eaceb27cc2fbf30f34a9d754b1"}
Jul 16 18:05:10.046121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.046060    2577 scope.go:117] "RemoveContainer" containerID="9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"
Jul 16 18:05:10.056313 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.056280    2577 scope.go:117] "RemoveContainer" containerID="9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"
Jul 16 18:05:10.056609 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:05:10.056586    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890\": container with ID starting with 9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890 not found: ID does not exist" containerID="9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"
Jul 16 18:05:10.056684 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.056618    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890"} err="failed to get container status \"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890\": rpc error: code = NotFound desc = could not find container \"9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890\": container with ID starting with 9e0df045df78a6d265490146fc7c943b5cd54d5fdd836c39ec35a3620a016890 not found: ID does not exist"
Jul 16 18:05:10.081699 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.081664    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:05:10.084138 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:10.084111    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-89f0be1f-85cb59f865-w8pds"]
Jul 16 18:05:11.923179 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:11.923149    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" path="/var/lib/kubelet/pods/aff5e66a-a245-4176-bfa1-da222b2c6cbb/volumes"
Jul 16 18:05:15.427087 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:15.427053    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:16.320045 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:16.320015    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:16.400343 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:16.400309    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:16.643318 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:16.643265    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:16.743987 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:16.743959    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:17.809450 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.809412    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:17.916737 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.916702    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:17.951217 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951189    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:05:17.951611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951597    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" containerName="maas-api"
Jul 16 18:05:17.951661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951612    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" containerName="maas-api"
Jul 16 18:05:17.951661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951628    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14942ac9-bdf7-4eb7-ad72-d03ba1c79c23" containerName="revoke-keys"
Jul 16 18:05:17.951661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951634    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="14942ac9-bdf7-4eb7-ad72-d03ba1c79c23" containerName="revoke-keys"
Jul 16 18:05:17.951756 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951711    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff5e66a-a245-4176-bfa1-da222b2c6cbb" containerName="maas-api"
Jul 16 18:05:17.951756 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.951720    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="14942ac9-bdf7-4eb7-ad72-d03ba1c79c23" containerName="revoke-keys"
Jul 16 18:05:17.955954 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.955934    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:17.971995 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.971973    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-57c731f2-serving-cert\""
Jul 16 18:05:17.975097 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:17.975043    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:05:18.016525 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.016491    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.016525 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.016524    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5shp\" (UniqueName: \"kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.016757 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.016629    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.023097 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.023065    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:18.117354 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.117317    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.117559 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.117385    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.117559 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.117408    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5shp\" (UniqueName: \"kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.117559 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:05:18.117527    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-serving-cert: secret "maas-api-e2e-ait-57c731f2-serving-cert" not found
Jul 16 18:05:18.117721 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:05:18.117603    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls podName:9dc569ce-5e0a-4a54-8872-f6e75c77264b nodeName:}" failed. No retries permitted until 2026-07-16 18:05:18.617586837 +0000 UTC m=+1943.261809693 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls") pod "maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" (UID: "9dc569ce-5e0a-4a54-8872-f6e75c77264b") : secret "maas-api-e2e-ait-57c731f2-serving-cert" not found
Jul 16 18:05:18.117918 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.117899    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.140481 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.140448    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5shp\" (UniqueName: \"kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.561646 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.561563    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:18.622171 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.622139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.624647 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.624623    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") pod \"maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:18.738067 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.738029    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:18.838873 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.838787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:18.866644 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:18.866610    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:19.012735 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:19.012709    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:05:19.013872 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:05:19.013846    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc569ce_5e0a_4a54_8872_f6e75c77264b.slice/crio-c9c3dc1a381a14d4aa23a73339cabdaf2eb61fb820a1677deb6df1b2445136dc WatchSource:0}: Error finding container c9c3dc1a381a14d4aa23a73339cabdaf2eb61fb820a1677deb6df1b2445136dc: Status 404 returned error can't find the container with id c9c3dc1a381a14d4aa23a73339cabdaf2eb61fb820a1677deb6df1b2445136dc
Jul 16 18:05:19.015462 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:19.015443    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:05:19.099140 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:19.099051    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" event={"ID":"9dc569ce-5e0a-4a54-8872-f6e75c77264b","Type":"ContainerStarted","Data":"c9c3dc1a381a14d4aa23a73339cabdaf2eb61fb820a1677deb6df1b2445136dc"}
Jul 16 18:05:19.863561 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:19.863526    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:20.106597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:20.106496    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" event={"ID":"9dc569ce-5e0a-4a54-8872-f6e75c77264b","Type":"ContainerStarted","Data":"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"}
Jul 16 18:05:20.106597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:20.106569    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:20.131611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:20.131551    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" podStartSLOduration=2.6374385179999997 podStartE2EDuration="3.131535631s" totalImagesPullingTime="494.097113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:20.130379626 +0000 UTC m=+1944.774602505" watchObservedRunningTime="2026-07-16 18:05:20.131535631 +0000 UTC m=+1944.775758509"
Jul 16 18:05:23.136953 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.136915    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:23.140788 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.140765    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:23.144853 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.144832    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:05:23.150380 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.150355    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:23.264233 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.264192    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-khzvl\" (UID: \"b0a777ed-f470-4673-9a5a-148c83bc7fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:23.365020 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.364987    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-khzvl\" (UID: \"b0a777ed-f470-4673-9a5a-148c83bc7fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:23.365653 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.365633    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-khzvl\" (UID: \"b0a777ed-f470-4673-9a5a-148c83bc7fba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:23.453895 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.453810    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:23.599550 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:23.599522    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:23.600648 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:05:23.600623    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0a777ed_f470_4673_9a5a_148c83bc7fba.slice/crio-1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d WatchSource:0}: Error finding container 1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d: Status 404 returned error can't find the container with id 1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d
Jul 16 18:05:24.136201 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:24.136168    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerStarted","Data":"209774e7cb62d68d9ae9994a865d2d02811d85d73a74b279051992541566dd63"}
Jul 16 18:05:24.136397 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:24.136219    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerStarted","Data":"1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d"}
Jul 16 18:05:24.156002 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:24.155955    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" podStartSLOduration=1.155941235 podStartE2EDuration="1.155941235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:05:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:05:24.154029545 +0000 UTC m=+1948.798252424" watchObservedRunningTime="2026-07-16 18:05:24.155941235 +0000 UTC m=+1948.800164113"
Jul 16 18:05:25.144203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:25.144168    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerID="209774e7cb62d68d9ae9994a865d2d02811d85d73a74b279051992541566dd63" exitCode=7
Jul 16 18:05:25.144425 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:25.144250    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerDied","Data":"209774e7cb62d68d9ae9994a865d2d02811d85d73a74b279051992541566dd63"}
Jul 16 18:05:25.144481 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:25.144433    2577 scope.go:117] "RemoveContainer" containerID="209774e7cb62d68d9ae9994a865d2d02811d85d73a74b279051992541566dd63"
Jul 16 18:05:26.118469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:26.118444    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:05:26.152649 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:26.152618    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerID="da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf" exitCode=7
Jul 16 18:05:26.152832 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:26.152699    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerDied","Data":"da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf"}
Jul 16 18:05:26.152832 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:26.152769    2577 scope.go:117] "RemoveContainer" containerID="209774e7cb62d68d9ae9994a865d2d02811d85d73a74b279051992541566dd63"
Jul 16 18:05:26.152982 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:26.152969    2577 scope.go:117] "RemoveContainer" containerID="da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf"
Jul 16 18:05:26.153247 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:05:26.153217    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-57c731f2-khzvl_odh-ai-gateway-infra(b0a777ed-f470-4673-9a5a-148c83bc7fba)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba"
Jul 16 18:05:27.160577 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:27.160548    2577 scope.go:117] "RemoveContainer" containerID="da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf"
Jul 16 18:05:27.161036 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:05:27.160777    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-57c731f2-khzvl_odh-ai-gateway-infra(b0a777ed-f470-4673-9a5a-148c83bc7fba)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba"
Jul 16 18:05:36.790864 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:36.790829    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:36.893850 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:36.893824    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:05:39.917806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:39.917768    2577 scope.go:117] "RemoveContainer" containerID="da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf"
Jul 16 18:05:41.244119 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:41.244085    2577 generic.go:356] "Generic (PLEG): container finished" podID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerID="8a0992ffbd1939da113c347e6b0c85edf6f2d104439624930583cb7475cd37de" exitCode=0
Jul 16 18:05:41.244557 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:41.244163    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerDied","Data":"8a0992ffbd1939da113c347e6b0c85edf6f2d104439624930583cb7475cd37de"}
Jul 16 18:05:41.244557 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:41.244267    2577 scope.go:117] "RemoveContainer" containerID="da4c3e2b3f9435ab504772bac615cbb602cd22de952c7bf9a82560df09e22abf"
Jul 16 18:05:42.277488 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:42.277457    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:42.395804 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:42.395778    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:42.539680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:42.539587    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca\") pod \"b0a777ed-f470-4673-9a5a-148c83bc7fba\" (UID: \"b0a777ed-f470-4673-9a5a-148c83bc7fba\") "
Jul 16 18:05:42.539998 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:42.539975    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0a777ed-f470-4673-9a5a-148c83bc7fba" (UID: "b0a777ed-f470-4673-9a5a-148c83bc7fba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:05:42.641195 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:42.641161    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0a777ed-f470-4673-9a5a-148c83bc7fba-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:05:43.257426 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.257394    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"
Jul 16 18:05:43.257608 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.257425    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl" event={"ID":"b0a777ed-f470-4673-9a5a-148c83bc7fba","Type":"ContainerDied","Data":"1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d"}
Jul 16 18:05:43.257608 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.257474    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1a7efea46c64eff6380be5dab6579921690868fecf6b597ee49e23196ccc741d"
Jul 16 18:05:43.293577 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.293545    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:43.299793 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.299767    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-khzvl"]
Jul 16 18:05:43.923630 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:05:43.923594    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" path="/var/lib/kubelet/pods/b0a777ed-f470-4673-9a5a-148c83bc7fba/volumes"
Jul 16 18:06:23.199784 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.199750    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"]
Jul 16 18:06:23.200203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200138    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200150    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200177    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200182    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200404 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200237    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200404 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200246    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.200404 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.200254    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:23.203535 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.203518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:23.206481 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.206457    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:06:23.213522 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.213497    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"]
Jul 16 18:06:23.300351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.300277    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-drbfk\" (UID: \"188d81f1-9fb5-4f73-bd57-c8b18b98b61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:23.401178 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.401130    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-drbfk\" (UID: \"188d81f1-9fb5-4f73-bd57-c8b18b98b61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:23.401776 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.401758    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-57c731f2-drbfk\" (UID: \"188d81f1-9fb5-4f73-bd57-c8b18b98b61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:23.514884 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.514797    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:23.652669 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:23.652641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"]
Jul 16 18:06:23.654228 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:06:23.654202    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188d81f1_9fb5_4f73_bd57_c8b18b98b61f.slice/crio-b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29 WatchSource:0}: Error finding container b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29: Status 404 returned error can't find the container with id b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29
Jul 16 18:06:24.498382 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:24.498351    2577 generic.go:356] "Generic (PLEG): container finished" podID="188d81f1-9fb5-4f73-bd57-c8b18b98b61f" containerID="c142307b3eaccccb12592d2b688f92719d96eccedf314ff275452cca1e8bc6f7" exitCode=0
Jul 16 18:06:24.498753 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:24.498436    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk" event={"ID":"188d81f1-9fb5-4f73-bd57-c8b18b98b61f","Type":"ContainerDied","Data":"c142307b3eaccccb12592d2b688f92719d96eccedf314ff275452cca1e8bc6f7"}
Jul 16 18:06:24.498753 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:24.498490    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk" event={"ID":"188d81f1-9fb5-4f73-bd57-c8b18b98b61f","Type":"ContainerStarted","Data":"b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29"}
Jul 16 18:06:25.640070 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:25.640048    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:25.723614 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:25.723576    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca\") pod \"188d81f1-9fb5-4f73-bd57-c8b18b98b61f\" (UID: \"188d81f1-9fb5-4f73-bd57-c8b18b98b61f\") "
Jul 16 18:06:25.723928 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:25.723907    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "188d81f1-9fb5-4f73-bd57-c8b18b98b61f" (UID: "188d81f1-9fb5-4f73-bd57-c8b18b98b61f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:06:25.825201 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:25.825130    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/188d81f1-9fb5-4f73-bd57-c8b18b98b61f-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:06:26.511048 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:26.511020    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk"
Jul 16 18:06:26.511048 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:26.511035    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-57c731f2-drbfk" event={"ID":"188d81f1-9fb5-4f73-bd57-c8b18b98b61f","Type":"ContainerDied","Data":"b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29"}
Jul 16 18:06:26.511285 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:26.511078    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b675cf086828f25a458163696e31babf9ef2630712fbd4c0c0aee3d3b1c46c29"
Jul 16 18:06:33.243115 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.243079    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:06:33.243647 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.243340    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" podUID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" containerName="maas-api" containerID="cri-o://4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f" gracePeriod=30
Jul 16 18:06:33.267960 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.267936    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:33.497493 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.497438    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:06:33.552691 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.552654    2577 generic.go:356] "Generic (PLEG): container finished" podID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" containerID="4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f" exitCode=0
Jul 16 18:06:33.552880 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.552709    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"
Jul 16 18:06:33.552880 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.552735    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" event={"ID":"9dc569ce-5e0a-4a54-8872-f6e75c77264b","Type":"ContainerDied","Data":"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"}
Jul 16 18:06:33.552880 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.552793    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb" event={"ID":"9dc569ce-5e0a-4a54-8872-f6e75c77264b","Type":"ContainerDied","Data":"c9c3dc1a381a14d4aa23a73339cabdaf2eb61fb820a1677deb6df1b2445136dc"}
Jul 16 18:06:33.552880 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.552825    2577 scope.go:117] "RemoveContainer" containerID="4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"
Jul 16 18:06:33.562231 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.562213    2577 scope.go:117] "RemoveContainer" containerID="4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"
Jul 16 18:06:33.562480 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:06:33.562461    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f\": container with ID starting with 4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f not found: ID does not exist" containerID="4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"
Jul 16 18:06:33.562535 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.562489    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f"} err="failed to get container status \"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f\": rpc error: code = NotFound desc = could not find container \"4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f\": container with ID starting with 4bc93a174f119298f907864809c06e5d348ee0fdc2114d57c6fa5b86a86a771f not found: ID does not exist"
Jul 16 18:06:33.589799 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.589779    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5shp\" (UniqueName: \"kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp\") pod \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") "
Jul 16 18:06:33.589903 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.589859    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") pod \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") "
Jul 16 18:06:33.589903 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.589895    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca\") pod \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\" (UID: \"9dc569ce-5e0a-4a54-8872-f6e75c77264b\") "
Jul 16 18:06:33.590267 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.590248    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9dc569ce-5e0a-4a54-8872-f6e75c77264b" (UID: "9dc569ce-5e0a-4a54-8872-f6e75c77264b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:06:33.591874 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.591846    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9dc569ce-5e0a-4a54-8872-f6e75c77264b" (UID: "9dc569ce-5e0a-4a54-8872-f6e75c77264b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:06:33.591979 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.591904    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp" (OuterVolumeSpecName: "kube-api-access-d5shp") pod "9dc569ce-5e0a-4a54-8872-f6e75c77264b" (UID: "9dc569ce-5e0a-4a54-8872-f6e75c77264b"). InnerVolumeSpecName "kube-api-access-d5shp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:06:33.691134 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.691104    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9dc569ce-5e0a-4a54-8872-f6e75c77264b-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:06:33.691134 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.691133    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9dc569ce-5e0a-4a54-8872-f6e75c77264b-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:06:33.691134 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.691142    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5shp\" (UniqueName: \"kubernetes.io/projected/9dc569ce-5e0a-4a54-8872-f6e75c77264b-kube-api-access-d5shp\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:06:33.878410 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.878384    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:06:33.884284 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.884261    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-57c731f2-6c8ff6cc4f-bjtfb"]
Jul 16 18:06:33.923131 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:33.923097    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" path="/var/lib/kubelet/pods/9dc569ce-5e0a-4a54-8872-f6e75c77264b/volumes"
Jul 16 18:06:38.415644 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:38.415615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:39.746566 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:39.746532    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:39.852647 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:39.852613    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:46.125192 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:46.125151    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:46.875779 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:46.875742    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:46.942592 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:46.942560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:47.194749 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:47.194717    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:47.299798 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:47.299760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:48.342636 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.342609    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:48.436285 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.436247    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:48.447878 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.447851    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:06:48.448245 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448233    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" containerName="maas-api"
Jul 16 18:06:48.448304 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448246    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" containerName="maas-api"
Jul 16 18:06:48.448304 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448253    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:48.448304 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448259    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0a777ed-f470-4673-9a5a-148c83bc7fba" containerName="revoke-keys"
Jul 16 18:06:48.448304 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448274    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="188d81f1-9fb5-4f73-bd57-c8b18b98b61f" containerName="revoke-keys"
Jul 16 18:06:48.448304 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448280    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="188d81f1-9fb5-4f73-bd57-c8b18b98b61f" containerName="revoke-keys"
Jul 16 18:06:48.448470 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448354    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dc569ce-5e0a-4a54-8872-f6e75c77264b" containerName="maas-api"
Jul 16 18:06:48.448470 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.448364    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="188d81f1-9fb5-4f73-bd57-c8b18b98b61f" containerName="revoke-keys"
Jul 16 18:06:48.452508 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.452489    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.455578 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.455556    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-7be4c90b-serving-cert\""
Jul 16 18:06:48.466404 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.466383    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:06:48.517516 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.517489    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.517691 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.517531    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.517691 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.517618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7fqc\" (UniqueName: \"kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.525617 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.525595    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:48.618541 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.618508    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7fqc\" (UniqueName: \"kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.618715 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.618569    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.618715 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.618592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.619308 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.619271    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.621028 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.621004    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.624727 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.624705    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:48.636553 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.636517    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7fqc\" (UniqueName: \"kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc\") pod \"maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:48.765126 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:48.765098    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:49.093176 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.093096    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:49.123257 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.123230    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:06:49.124500 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:06:49.124472    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf57301fa_57c5_44c5_8c59_833a36bbb21d.slice/crio-03782708411b47308b2e9c03d840376413d4d75e4bb86870787ea61f98c63e28 WatchSource:0}: Error finding container 03782708411b47308b2e9c03d840376413d4d75e4bb86870787ea61f98c63e28: Status 404 returned error can't find the container with id 03782708411b47308b2e9c03d840376413d4d75e4bb86870787ea61f98c63e28
Jul 16 18:06:49.191026 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.190997    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:49.654053 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.654013    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" event={"ID":"f57301fa-57c5-44c5-8c59-833a36bbb21d","Type":"ContainerStarted","Data":"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"}
Jul 16 18:06:49.654469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.654213    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:49.654469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.654259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" event={"ID":"f57301fa-57c5-44c5-8c59-833a36bbb21d","Type":"ContainerStarted","Data":"03782708411b47308b2e9c03d840376413d4d75e4bb86870787ea61f98c63e28"}
Jul 16 18:06:49.680487 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:49.680444    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" podStartSLOduration=1.252336087 podStartE2EDuration="1.680431377s" totalImagesPullingTime="428.09529ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:06:49.677963347 +0000 UTC m=+2034.322186226" watchObservedRunningTime="2026-07-16 18:06:49.680431377 +0000 UTC m=+2034.324654386"
Jul 16 18:06:50.590894 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:50.590862    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:06:52.719487 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.719451    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:06:52.723346 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.723327    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:06:52.726215 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.726191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:06:52.734614 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.734589    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:06:52.755571 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.755536    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js\" (UID: \"cd8d0414-0ae3-4788-a2b0-e53f0f79601e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:06:52.856595 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.856563    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js\" (UID: \"cd8d0414-0ae3-4788-a2b0-e53f0f79601e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:06:52.857149 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:52.857129    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js\" (UID: \"cd8d0414-0ae3-4788-a2b0-e53f0f79601e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:06:53.036258 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:53.036167    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:06:53.189976 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:53.189955    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:06:53.191869 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:06:53.191843    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8d0414_0ae3_4788_a2b0_e53f0f79601e.slice/crio-5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302 WatchSource:0}: Error finding container 5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302: Status 404 returned error can't find the container with id 5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302
Jul 16 18:06:53.679387 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:53.679356    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerStarted","Data":"cb3cab9fb166ed6abc19fc4f629084f8d66b71eb3f21a95308b05d5e8de4a7c9"}
Jul 16 18:06:53.679572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:53.679406    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerStarted","Data":"5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302"}
Jul 16 18:06:53.715215 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:53.715157    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" podStartSLOduration=1.715139892 podStartE2EDuration="1.715139892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:06:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:06:53.714245243 +0000 UTC m=+2038.358468208" watchObservedRunningTime="2026-07-16 18:06:53.715139892 +0000 UTC m=+2038.359362799"
Jul 16 18:06:54.687023 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:54.686984    2577 generic.go:356] "Generic (PLEG): container finished" podID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerID="cb3cab9fb166ed6abc19fc4f629084f8d66b71eb3f21a95308b05d5e8de4a7c9" exitCode=7
Jul 16 18:06:54.687466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:54.687056    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerDied","Data":"cb3cab9fb166ed6abc19fc4f629084f8d66b71eb3f21a95308b05d5e8de4a7c9"}
Jul 16 18:06:54.687466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:54.687272    2577 scope.go:117] "RemoveContainer" containerID="cb3cab9fb166ed6abc19fc4f629084f8d66b71eb3f21a95308b05d5e8de4a7c9"
Jul 16 18:06:55.667071 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:55.667044    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:06:55.694881 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:55.694848    2577 generic.go:356] "Generic (PLEG): container finished" podID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerID="75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66" exitCode=7
Jul 16 18:06:55.695349 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:55.694906    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerDied","Data":"75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66"}
Jul 16 18:06:55.695349 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:55.694963    2577 scope.go:117] "RemoveContainer" containerID="cb3cab9fb166ed6abc19fc4f629084f8d66b71eb3f21a95308b05d5e8de4a7c9"
Jul 16 18:06:55.695349 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:55.695120    2577 scope.go:117] "RemoveContainer" containerID="75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66"
Jul 16 18:06:55.695495 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:06:55.695393    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js_odh-ai-gateway-infra(cd8d0414-0ae3-4788-a2b0-e53f0f79601e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e"
Jul 16 18:06:56.702490 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:06:56.702464    2577 scope.go:117] "RemoveContainer" containerID="75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66"
Jul 16 18:06:56.702889 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:06:56.702676    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js_odh-ai-gateway-infra(cd8d0414-0ae3-4788-a2b0-e53f0f79601e)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e"
Jul 16 18:07:11.917478 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:11.917437    2577 scope.go:117] "RemoveContainer" containerID="75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66"
Jul 16 18:07:12.795605 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:12.795572    2577 generic.go:356] "Generic (PLEG): container finished" podID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerID="d94e5dc1f6bc68d4e6407622c800415c944dbf119ded580d8cb5b2d9ca824f45" exitCode=0
Jul 16 18:07:12.795790 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:12.795653    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerDied","Data":"d94e5dc1f6bc68d4e6407622c800415c944dbf119ded580d8cb5b2d9ca824f45"}
Jul 16 18:07:12.795790 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:12.795753    2577 scope.go:117] "RemoveContainer" containerID="75da2b20446bd7a0f8b55fe299cf56d2a92bf2afc0385346ca75de838dab6e66"
Jul 16 18:07:13.830353 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:13.830323    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:07:13.941555 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:13.941530    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:07:14.035882 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.035847    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca\") pod \"cd8d0414-0ae3-4788-a2b0-e53f0f79601e\" (UID: \"cd8d0414-0ae3-4788-a2b0-e53f0f79601e\") "
Jul 16 18:07:14.036273 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.036252    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cd8d0414-0ae3-4788-a2b0-e53f0f79601e" (UID: "cd8d0414-0ae3-4788-a2b0-e53f0f79601e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:07:14.137028 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.137003    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cd8d0414-0ae3-4788-a2b0-e53f0f79601e-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:07:14.810417 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.810388    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"
Jul 16 18:07:14.810599 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.810388    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js" event={"ID":"cd8d0414-0ae3-4788-a2b0-e53f0f79601e","Type":"ContainerDied","Data":"5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302"}
Jul 16 18:07:14.810599 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.810520    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d3897125da4fca49271864aed2ccc6a2c8d0ceda83a61eaa520b17ea3b20302"
Jul 16 18:07:14.847733 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.847705    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:07:14.854452 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:14.854431    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-xt4js"]
Jul 16 18:07:15.924069 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:15.924038    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" path="/var/lib/kubelet/pods/cd8d0414-0ae3-4788-a2b0-e53f0f79601e/volumes"
Jul 16 18:07:33.472503 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:33.472422    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:33.570166 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:33.570131    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:34.556470 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:34.556437    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:07:52.782600 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.782570    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"]
Jul 16 18:07:52.783027 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783007    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783027 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783018    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783027 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783033    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783049    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783055    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783114    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783122    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.783136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.783130    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8d0414-0ae3-4788-a2b0-e53f0f79601e" containerName="revoke-keys"
Jul 16 18:07:52.786486 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.786470    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:52.789526 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.789509    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:07:52.796905 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.796883    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"]
Jul 16 18:07:52.873946 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.873914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65\" (UID: \"8998fb80-278f-4bcb-b2cc-5d1e86c40beb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:52.975120 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.975089    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65\" (UID: \"8998fb80-278f-4bcb-b2cc-5d1e86c40beb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:52.975744 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:52.975724    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65\" (UID: \"8998fb80-278f-4bcb-b2cc-5d1e86c40beb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:53.097225 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:53.097149    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:53.232897 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:53.232867    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"]
Jul 16 18:07:53.234166 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:07:53.234132    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8998fb80_278f_4bcb_b2cc_5d1e86c40beb.slice/crio-09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18 WatchSource:0}: Error finding container 09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18: Status 404 returned error can't find the container with id 09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18
Jul 16 18:07:54.031358 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:54.031322    2577 generic.go:356] "Generic (PLEG): container finished" podID="8998fb80-278f-4bcb-b2cc-5d1e86c40beb" containerID="cb07a4f548dba44011da8f2766a0e9f63a91b34a40ea7b473c45fe94f89e1c56" exitCode=0
Jul 16 18:07:54.031713 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:54.031397    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65" event={"ID":"8998fb80-278f-4bcb-b2cc-5d1e86c40beb","Type":"ContainerDied","Data":"cb07a4f548dba44011da8f2766a0e9f63a91b34a40ea7b473c45fe94f89e1c56"}
Jul 16 18:07:54.031713 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:54.031448    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65" event={"ID":"8998fb80-278f-4bcb-b2cc-5d1e86c40beb","Type":"ContainerStarted","Data":"09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18"}
Jul 16 18:07:55.174342 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:55.174317    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:55.195488 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:55.195456    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca\") pod \"8998fb80-278f-4bcb-b2cc-5d1e86c40beb\" (UID: \"8998fb80-278f-4bcb-b2cc-5d1e86c40beb\") "
Jul 16 18:07:55.195866 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:55.195828    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8998fb80-278f-4bcb-b2cc-5d1e86c40beb" (UID: "8998fb80-278f-4bcb-b2cc-5d1e86c40beb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:07:55.296207 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:55.296125    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8998fb80-278f-4bcb-b2cc-5d1e86c40beb-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:07:56.004815 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.004790    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:07:56.007709 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.007684    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:07:56.012696 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.012666    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:07:56.015325 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.015306    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:07:56.043766 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.043744    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65"
Jul 16 18:07:56.043900 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.043744    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65" event={"ID":"8998fb80-278f-4bcb-b2cc-5d1e86c40beb","Type":"ContainerDied","Data":"09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18"}
Jul 16 18:07:56.043900 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:07:56.043853    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09c4baa8609767f63d00246a8cd795eba348787b48a9b2054619351e3f152a18"
Jul 16 18:08:02.829226 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:02.829193    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:08:02.829771 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:02.829450    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" podUID="f57301fa-57c5-44c5-8c59-833a36bbb21d" containerName="maas-api" containerID="cri-o://00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d" gracePeriod=30
Jul 16 18:08:02.861096 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:02.861071    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:03.086446 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.086383    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:08:03.091334 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.091285    2577 generic.go:356] "Generic (PLEG): container finished" podID="f57301fa-57c5-44c5-8c59-833a36bbb21d" containerID="00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d" exitCode=0
Jul 16 18:08:03.091454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.091361    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"
Jul 16 18:08:03.091454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.091387    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" event={"ID":"f57301fa-57c5-44c5-8c59-833a36bbb21d","Type":"ContainerDied","Data":"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"}
Jul 16 18:08:03.091454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.091435    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf" event={"ID":"f57301fa-57c5-44c5-8c59-833a36bbb21d","Type":"ContainerDied","Data":"03782708411b47308b2e9c03d840376413d4d75e4bb86870787ea61f98c63e28"}
Jul 16 18:08:03.091569 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.091461    2577 scope.go:117] "RemoveContainer" containerID="00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"
Jul 16 18:08:03.100636 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.100621    2577 scope.go:117] "RemoveContainer" containerID="00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"
Jul 16 18:08:03.100898 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:08:03.100880    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d\": container with ID starting with 00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d not found: ID does not exist" containerID="00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"
Jul 16 18:08:03.100968 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.100905    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d"} err="failed to get container status \"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d\": rpc error: code = NotFound desc = could not find container \"00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d\": container with ID starting with 00666d839381cb76375d63d3a32dfd7d8c214b34310e99a4f5087b7c54db157d not found: ID does not exist"
Jul 16 18:08:03.153606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.153575    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca\") pod \"f57301fa-57c5-44c5-8c59-833a36bbb21d\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") "
Jul 16 18:08:03.153763 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.153614    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r7fqc\" (UniqueName: \"kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc\") pod \"f57301fa-57c5-44c5-8c59-833a36bbb21d\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") "
Jul 16 18:08:03.153763 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.153682    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls\") pod \"f57301fa-57c5-44c5-8c59-833a36bbb21d\" (UID: \"f57301fa-57c5-44c5-8c59-833a36bbb21d\") "
Jul 16 18:08:03.153931 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.153910    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f57301fa-57c5-44c5-8c59-833a36bbb21d" (UID: "f57301fa-57c5-44c5-8c59-833a36bbb21d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:08:03.155619 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.155594    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f57301fa-57c5-44c5-8c59-833a36bbb21d" (UID: "f57301fa-57c5-44c5-8c59-833a36bbb21d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:08:03.155744 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.155725    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc" (OuterVolumeSpecName: "kube-api-access-r7fqc") pod "f57301fa-57c5-44c5-8c59-833a36bbb21d" (UID: "f57301fa-57c5-44c5-8c59-833a36bbb21d"). InnerVolumeSpecName "kube-api-access-r7fqc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:08:03.254572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.254534    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f57301fa-57c5-44c5-8c59-833a36bbb21d-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:08:03.254572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.254572    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f57301fa-57c5-44c5-8c59-833a36bbb21d-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:08:03.254572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.254582    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r7fqc\" (UniqueName: \"kubernetes.io/projected/f57301fa-57c5-44c5-8c59-833a36bbb21d-kube-api-access-r7fqc\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:08:03.416998 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.416967    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:08:03.426448 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.426418    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-7be4c90b-78dcbd9d6-fwksf"]
Jul 16 18:08:03.923491 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:03.923463    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f57301fa-57c5-44c5-8c59-833a36bbb21d" path="/var/lib/kubelet/pods/f57301fa-57c5-44c5-8c59-833a36bbb21d/volumes"
Jul 16 18:08:08.047210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:08.047178    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:08.220941 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:08.220909    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:08.339797 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:08.339716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:14.596963 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:14.596930    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:15.426036 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:15.426007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:15.528400 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:15.528370    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:15.967273 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:15.967235    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:16.065661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:16.065635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:16.166646 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:16.166615    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:17.710873 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:17.710847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:24.652332 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:24.652283    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:24.757713 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:24.757677    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:24.852268 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:24.852232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:24.961190 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:24.961089    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:25.433597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:25.433550    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:51.472332 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:51.472229    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:58.891263 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:58.891231    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:58.994141 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:58.994105    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:08:59.090723 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:08:59.090693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:15.138234 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:15.138179    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:21.743279 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:21.743244    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:21.819071 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:21.819028    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:21.937721 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:21.937689    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:22.056433 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:22.056362    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:32.570616 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:32.570582    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:33.461184 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:33.461150    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:41.540246 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:41.540198    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:41.647308 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:41.647267    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:41.744793 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:41.744760    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:41.840526 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:41.840451    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:42.677440 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:42.677413    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:42.776661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:42.776635    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:42.876588 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:42.876553    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:44.616094 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:44.616063    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:50.852385 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:50.852348    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:50.929726 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:50.929693    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:51.571445 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:51.571413    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:56.124019 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:56.123989    2577 scope.go:117] "RemoveContainer" containerID="d7e0001436154154db3819d2923de1b73d741a20a24bd0812c59c1dbf3b9978b"
Jul 16 18:09:58.520895 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:58.520861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:58.624217 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:58.624182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:58.795684 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:58.795602    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:59.116878 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:59.116828    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:09:59.675847 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:09:59.675807    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:02.174044 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.174007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:02.281425 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.281378    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:02.304361 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304325    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:02.304791 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304776    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f57301fa-57c5-44c5-8c59-833a36bbb21d" containerName="maas-api"
Jul 16 18:10:02.304791 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304792    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f57301fa-57c5-44c5-8c59-833a36bbb21d" containerName="maas-api"
Jul 16 18:10:02.304883 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304806    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8998fb80-278f-4bcb-b2cc-5d1e86c40beb" containerName="revoke-keys"
Jul 16 18:10:02.304883 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304811    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8998fb80-278f-4bcb-b2cc-5d1e86c40beb" containerName="revoke-keys"
Jul 16 18:10:02.304953 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304884    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8998fb80-278f-4bcb-b2cc-5d1e86c40beb" containerName="revoke-keys"
Jul 16 18:10:02.304953 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.304895    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f57301fa-57c5-44c5-8c59-833a36bbb21d" containerName="maas-api"
Jul 16 18:10:02.308047 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.308025    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.310773 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.310750    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-9826013b-serving-cert\""
Jul 16 18:10:02.319144 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.319117    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:02.371623 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.371588    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:02.405144 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.405109    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.405341 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.405209    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6d8k\" (UniqueName: \"kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.405341 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.405244    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.469866 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.469783    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:02.505908 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.505883    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6d8k\" (UniqueName: \"kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.506062 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.505914    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.506062 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.505961    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.506590 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.506573    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.508248 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.508227    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.515517 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.515492    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6d8k\" (UniqueName: \"kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k\") pod \"maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.620312 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.620264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:02.767957 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.767930    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:02.769672 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:10:02.769645    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbadbb24_8e20_4ee7_b82e_b5165ccde215.slice/crio-2b815eb1e3729bcd40be622512093cf5f089c2a24ebbb29ed12599cfd2b62737 WatchSource:0}: Error finding container 2b815eb1e3729bcd40be622512093cf5f089c2a24ebbb29ed12599cfd2b62737: Status 404 returned error can't find the container with id 2b815eb1e3729bcd40be622512093cf5f089c2a24ebbb29ed12599cfd2b62737
Jul 16 18:10:02.814920 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.814889    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" event={"ID":"bbadbb24-8e20-4ee7-b82e-b5165ccde215","Type":"ContainerStarted","Data":"2b815eb1e3729bcd40be622512093cf5f089c2a24ebbb29ed12599cfd2b62737"}
Jul 16 18:10:02.982407 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:02.982377    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:03.081930 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:03.081859    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:03.822355 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:03.822320    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" event={"ID":"bbadbb24-8e20-4ee7-b82e-b5165ccde215","Type":"ContainerStarted","Data":"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"}
Jul 16 18:10:03.822755 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:03.822491    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:03.849600 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:03.849551    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" podStartSLOduration=1.447823238 podStartE2EDuration="1.849531917s" totalImagesPullingTime="401.708679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:10:03.848232493 +0000 UTC m=+2228.492455373" watchObservedRunningTime="2026-07-16 18:10:03.849531917 +0000 UTC m=+2228.493754797"
Jul 16 18:10:06.717203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:06.717177    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:07.420602 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:07.420562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:07.519804 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:07.519777    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:07.888652 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:07.888622    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:09.834927 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:09.834899    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:14.243753 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.243721    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:14.344559 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.344533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:14.629843 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.629807    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"]
Jul 16 18:10:14.634158 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.634139    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:14.637010 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.636985    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:10:14.643673 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.643651    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"]
Jul 16 18:10:14.709509 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.709461    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9826013b-qsc9k\" (UID: \"71fee64e-b66e-4c12-9cee-e287801e089e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:14.810409 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.810371    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9826013b-qsc9k\" (UID: \"71fee64e-b66e-4c12-9cee-e287801e089e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:14.810988 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.810968    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9826013b-qsc9k\" (UID: \"71fee64e-b66e-4c12-9cee-e287801e089e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:14.946445 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:14.946353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:15.094419 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:15.094389    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"]
Jul 16 18:10:15.094758 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:10:15.094737    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71fee64e_b66e_4c12_9cee_e287801e089e.slice/crio-ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198 WatchSource:0}: Error finding container ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198: Status 404 returned error can't find the container with id ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198
Jul 16 18:10:15.897649 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:15.897620    2577 generic.go:356] "Generic (PLEG): container finished" podID="71fee64e-b66e-4c12-9cee-e287801e089e" containerID="2a44d68e89447a477319db165de5d57657cd07be0f864036819a5712ea4ab30e" exitCode=0
Jul 16 18:10:15.897969 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:15.897706    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k" event={"ID":"71fee64e-b66e-4c12-9cee-e287801e089e","Type":"ContainerDied","Data":"2a44d68e89447a477319db165de5d57657cd07be0f864036819a5712ea4ab30e"}
Jul 16 18:10:15.897969 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:15.897759    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k" event={"ID":"71fee64e-b66e-4c12-9cee-e287801e089e","Type":"ContainerStarted","Data":"ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198"}
Jul 16 18:10:17.042015 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.041992    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:17.130557 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.130487    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca\") pod \"71fee64e-b66e-4c12-9cee-e287801e089e\" (UID: \"71fee64e-b66e-4c12-9cee-e287801e089e\") "
Jul 16 18:10:17.130809 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.130789    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "71fee64e-b66e-4c12-9cee-e287801e089e" (UID: "71fee64e-b66e-4c12-9cee-e287801e089e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:17.231844 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.231769    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/71fee64e-b66e-4c12-9cee-e287801e089e-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:10:17.910872 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.910842    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k"
Jul 16 18:10:17.910872 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.910858    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9826013b-qsc9k" event={"ID":"71fee64e-b66e-4c12-9cee-e287801e089e","Type":"ContainerDied","Data":"ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198"}
Jul 16 18:10:17.911081 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:17.910901    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ecf5c05562845b263ef09985cc27bb66d9254c03342d163a1e6d34b4c9475198"
Jul 16 18:10:24.666811 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.666773    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:24.667544 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.667152    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerName="maas-api" containerID="cri-o://e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338" gracePeriod=30
Jul 16 18:10:24.721764 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.721739    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:24.830355 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.830306    2577 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.73:8443/health\": dial tcp 10.134.0.73:8443: connect: connection refused"
Jul 16 18:10:24.933966 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.933943    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:24.955932 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.955901    2577 generic.go:356] "Generic (PLEG): container finished" podID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerID="e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338" exitCode=0
Jul 16 18:10:24.956106 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.956078    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" event={"ID":"bbadbb24-8e20-4ee7-b82e-b5165ccde215","Type":"ContainerDied","Data":"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"}
Jul 16 18:10:24.956199 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.956175    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb" event={"ID":"bbadbb24-8e20-4ee7-b82e-b5165ccde215","Type":"ContainerDied","Data":"2b815eb1e3729bcd40be622512093cf5f089c2a24ebbb29ed12599cfd2b62737"}
Jul 16 18:10:24.956199 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.956193    2577 scope.go:117] "RemoveContainer" containerID="e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"
Jul 16 18:10:24.956339 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.956112    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"
Jul 16 18:10:24.967475 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.967441    2577 scope.go:117] "RemoveContainer" containerID="e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"
Jul 16 18:10:24.967722 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:10:24.967702    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338\": container with ID starting with e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338 not found: ID does not exist" containerID="e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"
Jul 16 18:10:24.967806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:24.967732    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338"} err="failed to get container status \"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338\": rpc error: code = NotFound desc = could not find container \"e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338\": container with ID starting with e8faca1f45c9f5fe7db561dfe7184fb68b3014fcef4a80752e57fa5e31c75338 not found: ID does not exist"
Jul 16 18:10:25.095149 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.095118    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6d8k\" (UniqueName: \"kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k\") pod \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") "
Jul 16 18:10:25.095351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.095163    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca\") pod \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") "
Jul 16 18:10:25.095351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.095215    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls\") pod \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\" (UID: \"bbadbb24-8e20-4ee7-b82e-b5165ccde215\") "
Jul 16 18:10:25.095566 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.095542    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bbadbb24-8e20-4ee7-b82e-b5165ccde215" (UID: "bbadbb24-8e20-4ee7-b82e-b5165ccde215"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:10:25.097264 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.097232    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k" (OuterVolumeSpecName: "kube-api-access-s6d8k") pod "bbadbb24-8e20-4ee7-b82e-b5165ccde215" (UID: "bbadbb24-8e20-4ee7-b82e-b5165ccde215"). InnerVolumeSpecName "kube-api-access-s6d8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:10:25.097264 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.097239    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bbadbb24-8e20-4ee7-b82e-b5165ccde215" (UID: "bbadbb24-8e20-4ee7-b82e-b5165ccde215"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:10:25.195800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.195735    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6d8k\" (UniqueName: \"kubernetes.io/projected/bbadbb24-8e20-4ee7-b82e-b5165ccde215-kube-api-access-s6d8k\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:10:25.195800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.195755    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbadbb24-8e20-4ee7-b82e-b5165ccde215-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:10:25.195800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.195765    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbadbb24-8e20-4ee7-b82e-b5165ccde215-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:10:25.283556 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.283528    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:25.289867 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.289842    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-9826013b-77b8d7c54f-smqvb"]
Jul 16 18:10:25.923494 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:25.923467    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" path="/var/lib/kubelet/pods/bbadbb24-8e20-4ee7-b82e-b5165ccde215/volumes"
Jul 16 18:10:29.824745 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:29.824707    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:30.243439 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:30.243410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:36.861703 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:36.861652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:36.932466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:36.932436    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:37.149495 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:37.149467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:37.423562 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:37.423485    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:37.528936 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:37.528887    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:37.626341 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:37.626305    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:37.780343 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:37.780249    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:38.057397 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:38.057283    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:38.153573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:38.153542    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:44.364769 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:44.364735    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:44.482607 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:44.482571    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:44.581767 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:44.581737    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:44.742908 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:44.742877    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.780475 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:51.780435    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:51.880874 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:51.880841    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:56.148858 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:56.148825    2577 scope.go:117] "RemoveContainer" containerID="bc6d6b34cd215acc80a7d966cdb8069cbb4628880e1cdc2c923f647652f8458f"
Jul 16 18:10:58.763211 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:58.763174    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:59.099579 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:59.099495    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:10:59.633939 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:10:59.633902    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:02.612093 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.612067    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:02.703913 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.703876    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:02.704330 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704307    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerName="maas-api"
Jul 16 18:11:02.704330 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704324    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerName="maas-api"
Jul 16 18:11:02.704330 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704333    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71fee64e-b66e-4c12-9cee-e287801e089e" containerName="revoke-keys"
Jul 16 18:11:02.704569 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704339    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="71fee64e-b66e-4c12-9cee-e287801e089e" containerName="revoke-keys"
Jul 16 18:11:02.704569 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704414    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="71fee64e-b66e-4c12-9cee-e287801e089e" containerName="revoke-keys"
Jul 16 18:11:02.704569 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.704427    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbadbb24-8e20-4ee7-b82e-b5165ccde215" containerName="maas-api"
Jul 16 18:11:02.705193 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.705157    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:02.707594 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.707577    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.710454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.710434    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-7a2e4989-serving-cert\""
Jul 16 18:11:02.720456 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.720433    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:02.792016 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.791982    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:02.835909 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.835875    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.836092 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.835928    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.836092 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.836005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rpwt\" (UniqueName: \"kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.886388 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.886352    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:02.936449 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.936419    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.936627 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.936462    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.936677 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.936643    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rpwt\" (UniqueName: \"kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.937019 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.937002    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.938869 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.938848    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:02.948519 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:02.948494    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rpwt\" (UniqueName: \"kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt\") pod \"maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:03.017622 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.017592    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:03.162356 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.162089    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:03.164773 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:11:03.164742    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c58370_0ac6_40bd_9f2e_7b9cbe52255a.slice/crio-fd2c837cd6cf71aac7c506e2b6c9a50ac05d3beaf957c87e665824ce30afc2a8 WatchSource:0}: Error finding container fd2c837cd6cf71aac7c506e2b6c9a50ac05d3beaf957c87e665824ce30afc2a8: Status 404 returned error can't find the container with id fd2c837cd6cf71aac7c506e2b6c9a50ac05d3beaf957c87e665824ce30afc2a8
Jul 16 18:11:03.166572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.166547    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:11:03.181933 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.181902    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" event={"ID":"96c58370-0ac6-40bd-9f2e-7b9cbe52255a","Type":"ContainerStarted","Data":"fd2c837cd6cf71aac7c506e2b6c9a50ac05d3beaf957c87e665824ce30afc2a8"}
Jul 16 18:11:03.478983 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.478901    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:03.581038 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:03.581001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:04.188891 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:04.188857    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" event={"ID":"96c58370-0ac6-40bd-9f2e-7b9cbe52255a","Type":"ContainerStarted","Data":"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"}
Jul 16 18:11:04.189352 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:04.189001    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:04.218151 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:04.218094    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" podStartSLOduration=1.844443155 podStartE2EDuration="2.218078966s" totalImagesPullingTime="373.635811ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:11:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:04.21543271 +0000 UTC m=+2288.859655588" watchObservedRunningTime="2026-07-16 18:11:04.218078966 +0000 UTC m=+2288.862301864"
Jul 16 18:11:07.046422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:07.046388    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:10.200434 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:10.200402    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:12.713224 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:12.713182    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:35.527790 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.527753    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"]
Jul 16 18:11:35.531338 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.531313    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:35.534191 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.534171    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:11:35.542826 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.542801    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"]
Jul 16 18:11:35.611431 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.611399    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f\" (UID: \"c3175ffb-c8cd-4222-b89f-32c6c12474dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:35.712775 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.712731    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f\" (UID: \"c3175ffb-c8cd-4222-b89f-32c6c12474dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:35.713494 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.713473    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f\" (UID: \"c3175ffb-c8cd-4222-b89f-32c6c12474dc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:35.845466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.845386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:35.989690 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:35.989658    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"]
Jul 16 18:11:35.991173 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:11:35.991148    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3175ffb_c8cd_4222_b89f_32c6c12474dc.slice/crio-cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40 WatchSource:0}: Error finding container cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40: Status 404 returned error can't find the container with id cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40
Jul 16 18:11:36.384119 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:36.384079    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f" event={"ID":"c3175ffb-c8cd-4222-b89f-32c6c12474dc","Type":"ContainerStarted","Data":"4fada4a59662cad20171c17ce112369f2cf5e1b7f881c171c2245c6c3dd5e412"}
Jul 16 18:11:36.384316 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:36.384146    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f" event={"ID":"c3175ffb-c8cd-4222-b89f-32c6c12474dc","Type":"ContainerStarted","Data":"cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40"}
Jul 16 18:11:36.409165 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:36.409114    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f" podStartSLOduration=1.409098791 podStartE2EDuration="1.409098791s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:11:36.405622949 +0000 UTC m=+2321.049845829" watchObservedRunningTime="2026-07-16 18:11:36.409098791 +0000 UTC m=+2321.053321767"
Jul 16 18:11:37.390912 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:37.390879    2577 generic.go:356] "Generic (PLEG): container finished" podID="c3175ffb-c8cd-4222-b89f-32c6c12474dc" containerID="4fada4a59662cad20171c17ce112369f2cf5e1b7f881c171c2245c6c3dd5e412" exitCode=0
Jul 16 18:11:37.390912 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:37.390916    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f" event={"ID":"c3175ffb-c8cd-4222-b89f-32c6c12474dc","Type":"ContainerDied","Data":"4fada4a59662cad20171c17ce112369f2cf5e1b7f881c171c2245c6c3dd5e412"}
Jul 16 18:11:38.542844 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:38.542812    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:38.631043 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:38.631009    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca\") pod \"c3175ffb-c8cd-4222-b89f-32c6c12474dc\" (UID: \"c3175ffb-c8cd-4222-b89f-32c6c12474dc\") "
Jul 16 18:11:38.631379 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:38.631355    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c3175ffb-c8cd-4222-b89f-32c6c12474dc" (UID: "c3175ffb-c8cd-4222-b89f-32c6c12474dc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:11:38.731675 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:38.731588    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3175ffb-c8cd-4222-b89f-32c6c12474dc-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:11:39.404166 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:39.404137    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f"
Jul 16 18:11:39.404378 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:39.404180    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f" event={"ID":"c3175ffb-c8cd-4222-b89f-32c6c12474dc","Type":"ContainerDied","Data":"cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40"}
Jul 16 18:11:39.404378 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:39.404234    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd706b0dec2285c417bce62800d5293ba1448ce469e9ff8584e4cd63b1be9d40"
Jul 16 18:11:43.616497 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:43.616467    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:43.717691 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:43.717661    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:50.576709 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.576625    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:50.577195 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.576840    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" podUID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" containerName="maas-api" containerID="cri-o://acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3" gracePeriod=30
Jul 16 18:11:50.617493 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.617458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:50.834208 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.834139    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:50.935208 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.935174    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls\") pod \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") "
Jul 16 18:11:50.935407 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.935248    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca\") pod \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") "
Jul 16 18:11:50.935407 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.935285    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rpwt\" (UniqueName: \"kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt\") pod \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\" (UID: \"96c58370-0ac6-40bd-9f2e-7b9cbe52255a\") "
Jul 16 18:11:50.935633 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.935614    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "96c58370-0ac6-40bd-9f2e-7b9cbe52255a" (UID: "96c58370-0ac6-40bd-9f2e-7b9cbe52255a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:11:50.937476 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.937450    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "96c58370-0ac6-40bd-9f2e-7b9cbe52255a" (UID: "96c58370-0ac6-40bd-9f2e-7b9cbe52255a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:11:50.937573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:50.937494    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt" (OuterVolumeSpecName: "kube-api-access-5rpwt") pod "96c58370-0ac6-40bd-9f2e-7b9cbe52255a" (UID: "96c58370-0ac6-40bd-9f2e-7b9cbe52255a"). InnerVolumeSpecName "kube-api-access-5rpwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:11:51.036101 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.036068    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:11:51.036101 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.036095    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:11:51.036101 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.036107    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rpwt\" (UniqueName: \"kubernetes.io/projected/96c58370-0ac6-40bd-9f2e-7b9cbe52255a-kube-api-access-5rpwt\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:11:51.475745 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.475708    2577 generic.go:356] "Generic (PLEG): container finished" podID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" containerID="acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3" exitCode=0
Jul 16 18:11:51.475920 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.475753    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" event={"ID":"96c58370-0ac6-40bd-9f2e-7b9cbe52255a","Type":"ContainerDied","Data":"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"}
Jul 16 18:11:51.475920 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.475797    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7" event={"ID":"96c58370-0ac6-40bd-9f2e-7b9cbe52255a","Type":"ContainerDied","Data":"fd2c837cd6cf71aac7c506e2b6c9a50ac05d3beaf957c87e665824ce30afc2a8"}
Jul 16 18:11:51.475920 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.475819    2577 scope.go:117] "RemoveContainer" containerID="acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"
Jul 16 18:11:51.475920 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.475757    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"
Jul 16 18:11:51.489207 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.489180    2577 scope.go:117] "RemoveContainer" containerID="acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"
Jul 16 18:11:51.489677 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:11:51.489650    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3\": container with ID starting with acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3 not found: ID does not exist" containerID="acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"
Jul 16 18:11:51.489767 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.489689    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3"} err="failed to get container status \"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3\": rpc error: code = NotFound desc = could not find container \"acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3\": container with ID starting with acec8b12be41304889afcb34e6816975b49941564087ccae46231136505e82b3 not found: ID does not exist"
Jul 16 18:11:51.507606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.507573    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:51.512380 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.512355    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-7a2e4989-75b799d4bc-wzhl7"]
Jul 16 18:11:51.924093 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:51.924047    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" path="/var/lib/kubelet/pods/96c58370-0ac6-40bd-9f2e-7b9cbe52255a/volumes"
Jul 16 18:11:55.769007 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:55.768954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:11:56.177078 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:56.177046    2577 scope.go:117] "RemoveContainer" containerID="8a0992ffbd1939da113c347e6b0c85edf6f2d104439624930583cb7475cd37de"
Jul 16 18:11:58.180081 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:11:58.180041    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:03.255011 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:03.254968    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:40.094458 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:40.094400    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:41.496390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:41.496353    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:47.700063 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:47.700001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:54.022871 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:54.022842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:54.093573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:54.093544    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:54.361490 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:54.361404    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:54.610233 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:54.610205    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:55.910418 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:55.910378    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:56.004005 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.003964    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:56.043247 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.043218    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:12:56.046184 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.046159    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:12:56.052729 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.052709    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:12:56.055536 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.055519    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:12:56.102383 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.102351    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:56.986252 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:56.986214    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:57.095765 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:57.095729    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:57.203665 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:57.203626    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:12:58.755390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:12:58.755356    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:06.086986 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:06.086937    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:07.361367 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:07.361341    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:14.383141 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:14.383110    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:14.488501 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:14.488466    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:14.598091 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:14.598062    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:25.185495 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:25.185410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:25.569930 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:25.569842    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:46.652362 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:46.652284    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:54.797688 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:54.797657    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:54.912320 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:54.909428    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:55.205985 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:55.205954    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:55.531160 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:55.531074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:55.769778 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:55.769747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:56.211986 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:56.211957    2577 scope.go:117] "RemoveContainer" containerID="d94e5dc1f6bc68d4e6407622c800415c944dbf119ded580d8cb5b2d9ca824f45"
Jul 16 18:13:58.400918 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.400889    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:58.501722 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.501691    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:13:58.502187 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502167    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" containerName="maas-api"
Jul 16 18:13:58.502187 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502186    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" containerName="maas-api"
Jul 16 18:13:58.502366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502204    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3175ffb-c8cd-4222-b89f-32c6c12474dc" containerName="revoke-keys"
Jul 16 18:13:58.502366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502211    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3175ffb-c8cd-4222-b89f-32c6c12474dc" containerName="revoke-keys"
Jul 16 18:13:58.502366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502278    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="96c58370-0ac6-40bd-9f2e-7b9cbe52255a" containerName="maas-api"
Jul 16 18:13:58.502366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.502303    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3175ffb-c8cd-4222-b89f-32c6c12474dc" containerName="revoke-keys"
Jul 16 18:13:58.507010 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.506986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.510573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.510547    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a1a1f5-serving-cert\""
Jul 16 18:13:58.521725 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.521705    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:13:58.530929 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.530903    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:58.573355 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.573332    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2c5x\" (UniqueName: \"kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.573489 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.573363    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.573489 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.573388    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.635486 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.635454    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:58.674148 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.674073    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2c5x\" (UniqueName: \"kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.674148 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.674105    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.674148 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.674139    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.674376 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:13:58.674236    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-serving-cert: secret "maas-api-e2e-inf-a-a1a1f5-serving-cert" not found
Jul 16 18:13:58.674376 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:13:58.674340    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls podName:f2c6a44f-ea92-4c0f-aece-1a565f3292ce nodeName:}" failed. No retries permitted until 2026-07-16 18:13:59.174319165 +0000 UTC m=+2463.818542025 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls") pod "maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" (UID: "f2c6a44f-ea92-4c0f-aece-1a565f3292ce") : secret "maas-api-e2e-inf-a-a1a1f5-serving-cert" not found
Jul 16 18:13:58.674753 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.674737    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.703343 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.703318    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2c5x\" (UniqueName: \"kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:58.794596 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:58.794560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:59.179868 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.179834    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:59.182177 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.182156    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") pod \"maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:59.418345 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.418282    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:13:59.546770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.546737    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:13:59.594539 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.594511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:13:59.595899 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:13:59.595873    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c6a44f_ea92_4c0f_aece_1a565f3292ce.slice/crio-fe3c1e86b46ac465aed99be3af01ab17cf12a1e8409e06bf76c6d948824c83d9 WatchSource:0}: Error finding container fe3c1e86b46ac465aed99be3af01ab17cf12a1e8409e06bf76c6d948824c83d9: Status 404 returned error can't find the container with id fe3c1e86b46ac465aed99be3af01ab17cf12a1e8409e06bf76c6d948824c83d9
Jul 16 18:13:59.674573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:13:59.674543    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:00.264468 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:00.264432    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" event={"ID":"f2c6a44f-ea92-4c0f-aece-1a565f3292ce","Type":"ContainerStarted","Data":"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"}
Jul 16 18:14:00.264468 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:00.264485    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" event={"ID":"f2c6a44f-ea92-4c0f-aece-1a565f3292ce","Type":"ContainerStarted","Data":"fe3c1e86b46ac465aed99be3af01ab17cf12a1e8409e06bf76c6d948824c83d9"}
Jul 16 18:14:00.264780 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:00.264538    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:14:00.297099 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:00.297038    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" podStartSLOduration=1.8032930729999999 podStartE2EDuration="2.297021707s" totalImagesPullingTime="493.728634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:13:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:14:00.295354324 +0000 UTC m=+2464.939577204" watchObservedRunningTime="2026-07-16 18:14:00.297021707 +0000 UTC m=+2464.941244585"
Jul 16 18:14:03.004351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:03.004314    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:03.386046 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:03.386019    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:04.004680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:04.004648    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:04.207582 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:04.207547    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:06.275566 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:06.275539    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:14:07.348757 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.348723    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:07.431545 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.431510    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:14:07.436059 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.436036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.438466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.438438    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:07.438801 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.438779    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-28bbcf-serving-cert\""
Jul 16 18:14:07.445558 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.445535    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:14:07.521839 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.521805    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:07.549813 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.549787    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.549940 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.549814    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.549940 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.549921    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lp4fx\" (UniqueName: \"kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.647276 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.647248    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:07.650428 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.650402    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lp4fx\" (UniqueName: \"kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.650555 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.650486    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.650555 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.650512    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.651146 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.651126    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.652747 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.652730    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.662562 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.662541    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lp4fx\" (UniqueName: \"kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx\") pod \"maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.749824 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.749791    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:07.890571 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:07.890542    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:14:07.891967 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:14:07.891942    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8737ad_f702_47b5_9622_297edba5ddb0.slice/crio-ad672f3061cd0024e6f94b51cd960bf5b65b2e81cbfbb67682f1940142905545 WatchSource:0}: Error finding container ad672f3061cd0024e6f94b51cd960bf5b65b2e81cbfbb67682f1940142905545: Status 404 returned error can't find the container with id ad672f3061cd0024e6f94b51cd960bf5b65b2e81cbfbb67682f1940142905545
Jul 16 18:14:08.173867 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.173836    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:08.278274 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.278250    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:08.316988 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.316959    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" event={"ID":"4e8737ad-f702-47b5-9622-297edba5ddb0","Type":"ContainerStarted","Data":"ad672f3061cd0024e6f94b51cd960bf5b65b2e81cbfbb67682f1940142905545"}
Jul 16 18:14:08.317088 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.317031    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:08.339611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.339566    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" podStartSLOduration=0.980201107 podStartE2EDuration="1.33954942s" totalImagesPullingTime="359.348313ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:14:08.337230461 +0000 UTC m=+2472.981453356" watchObservedRunningTime="2026-07-16 18:14:08.33954942 +0000 UTC m=+2472.983772299"
Jul 16 18:14:08.526923 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:08.526820    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:09.324785 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:09.324702    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" event={"ID":"4e8737ad-f702-47b5-9622-297edba5ddb0","Type":"ContainerStarted","Data":"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"}
Jul 16 18:14:11.856388 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:11.856359    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:15.335972 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:15.335945    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:14:20.340906 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:20.340877    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:20.656260 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:20.656225    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:20.767002 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:20.766969    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:30.428952 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:30.428918    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:30.528507 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:30.528477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:40.390413 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:40.390376    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:14:59.838668 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:14:59.838633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:00.161121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.161091    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"]
Jul 16 18:15:00.164456 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.164440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"
Jul 16 18:15:00.168014 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.167991    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:15:00.168749 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.168730    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"]
Jul 16 18:15:00.172042 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.172024    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"]
Jul 16 18:15:00.172162 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.172141    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"
Jul 16 18:15:00.175126 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.175102    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"
Jul 16 18:15:00.175564 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.175548    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"
Jul 16 18:15:00.180564 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.180511    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"]
Jul 16 18:15:00.187991 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.187961    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"]
Jul 16 18:15:00.189146 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.189125    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"
Jul 16 18:15:00.194855 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.194828    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"]
Jul 16 18:15:00.231335 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.230606    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"
Jul 16 18:15:00.372941 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.372902    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"]
Jul 16 18:15:00.375662 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:15:00.375636    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8948c119_a97b_4d72_83c6_b7047cda79b3.slice/crio-595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6 WatchSource:0}: Error finding container 595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6: Status 404 returned error can't find the container with id 595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6
Jul 16 18:15:00.426078 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.426050    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"]
Jul 16 18:15:00.427252 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:15:00.427222    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677a8b30_1311_4dc7_9f27_d00b1521a408.slice/crio-bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6 WatchSource:0}: Error finding container bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6: Status 404 returned error can't find the container with id bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6
Jul 16 18:15:00.592040 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.592017    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"]
Jul 16 18:15:00.593430 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:15:00.593400    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b449d9_9fc0_4fce_9d6c_8a32ca10e3a3.slice/crio-54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9 WatchSource:0}: Error finding container 54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9: Status 404 returned error can't find the container with id 54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9
Jul 16 18:15:00.635253 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.635215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz" event={"ID":"677a8b30-1311-4dc7-9f27-d00b1521a408","Type":"ContainerStarted","Data":"bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6"}
Jul 16 18:15:00.637212 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.637185    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f" event={"ID":"8948c119-a97b-4d72-83c6-b7047cda79b3","Type":"ContainerStarted","Data":"595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6"}
Jul 16 18:15:00.638551 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:00.638529    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5" event={"ID":"30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3","Type":"ContainerStarted","Data":"54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9"}
Jul 16 18:15:01.645641 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.645609    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5" event={"ID":"30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3","Type":"ContainerStarted","Data":"1ea66a13f68dabaf9136eeea783e3db20b5b538d5bfc7db58b94df1ed7ea0804"}
Jul 16 18:15:01.647197 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.647171    2577 generic.go:356] "Generic (PLEG): container finished" podID="677a8b30-1311-4dc7-9f27-d00b1521a408" containerID="cffec38a5b55735def10472141bf8c811f2d433a0c6c58de5678c9d5beee833b" exitCode=0
Jul 16 18:15:01.647331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.647256    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz" event={"ID":"677a8b30-1311-4dc7-9f27-d00b1521a408","Type":"ContainerDied","Data":"cffec38a5b55735def10472141bf8c811f2d433a0c6c58de5678c9d5beee833b"}
Jul 16 18:15:01.648747 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.648722    2577 generic.go:356] "Generic (PLEG): container finished" podID="8948c119-a97b-4d72-83c6-b7047cda79b3" containerID="7c7041195658c52e6fe36eb2f7f5497e70f7e2b47006b676f039e57c7bfa20b9" exitCode=0
Jul 16 18:15:01.648856 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.648799    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f" event={"ID":"8948c119-a97b-4d72-83c6-b7047cda79b3","Type":"ContainerDied","Data":"7c7041195658c52e6fe36eb2f7f5497e70f7e2b47006b676f039e57c7bfa20b9"}
Jul 16 18:15:01.665642 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:01.665598    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5" podStartSLOduration=1.665584857 podStartE2EDuration="1.665584857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:15:01.662939985 +0000 UTC m=+2526.307162866" watchObservedRunningTime="2026-07-16 18:15:01.665584857 +0000 UTC m=+2526.309807788"
Jul 16 18:15:02.656792 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:02.656758    2577 generic.go:356] "Generic (PLEG): container finished" podID="30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3" containerID="1ea66a13f68dabaf9136eeea783e3db20b5b538d5bfc7db58b94df1ed7ea0804" exitCode=0
Jul 16 18:15:02.657234 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:02.656828    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5" event={"ID":"30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3","Type":"ContainerDied","Data":"1ea66a13f68dabaf9136eeea783e3db20b5b538d5bfc7db58b94df1ed7ea0804"}
Jul 16 18:15:02.806504 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:02.806475    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"
Jul 16 18:15:02.843798 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:02.843764    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"
Jul 16 18:15:03.664851 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.664824    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"
Jul 16 18:15:03.665345 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.664856    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz" event={"ID":"677a8b30-1311-4dc7-9f27-d00b1521a408","Type":"ContainerDied","Data":"bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6"}
Jul 16 18:15:03.665345 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.664904    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbcb69be6bcd85752a6b9510f871b342b2f9b2400aaf1f2ece51b9cc2cfca5d6"
Jul 16 18:15:03.666203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.666186    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"
Jul 16 18:15:03.666345 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.666231    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f" event={"ID":"8948c119-a97b-4d72-83c6-b7047cda79b3","Type":"ContainerDied","Data":"595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6"}
Jul 16 18:15:03.666345 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.666269    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="595ba35fd3fc1680780ad0106db3599302bfa54bef646167cdc6925101acb9f6"
Jul 16 18:15:03.806671 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:03.806642    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"
Jul 16 18:15:04.673572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:04.673541    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5" event={"ID":"30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3","Type":"ContainerDied","Data":"54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9"}
Jul 16 18:15:04.673983 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:04.673592    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54e2decc793c868f45a1ed7ce6cb6a2e51e7b52a34295bb70ecd6f903d607fa9"
Jul 16 18:15:04.673983 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:04.673549    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29737095-c4nh5"
Jul 16 18:15:26.463665 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:26.463629    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:36.800571 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:36.800538    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:36.868261 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:36.868215    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:39.028881 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:39.028847    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:39.128044 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:39.128007    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:15:50.940047 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:15:50.940011    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:12.414571 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:12.414533    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:13.397748 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.397716    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:13.517935 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.517894    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"]
Jul 16 18:16:13.518522 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518502    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8948c119-a97b-4d72-83c6-b7047cda79b3" containerName="cleanup"
Jul 16 18:16:13.518606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518524    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8948c119-a97b-4d72-83c6-b7047cda79b3" containerName="cleanup"
Jul 16 18:16:13.518606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518537    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="677a8b30-1311-4dc7-9f27-d00b1521a408" containerName="cleanup"
Jul 16 18:16:13.518606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518546    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="677a8b30-1311-4dc7-9f27-d00b1521a408" containerName="cleanup"
Jul 16 18:16:13.518606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518559    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3" containerName="cleanup"
Jul 16 18:16:13.518606 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518568    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3" containerName="cleanup"
Jul 16 18:16:13.518850 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518700    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3" containerName="cleanup"
Jul 16 18:16:13.518850 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518714    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8948c119-a97b-4d72-83c6-b7047cda79b3" containerName="cleanup"
Jul 16 18:16:13.518850 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.518726    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="677a8b30-1311-4dc7-9f27-d00b1521a408" containerName="cleanup"
Jul 16 18:16:13.522300 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.522264    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:13.524985 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.524969    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:16:13.529860 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.529837    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"]
Jul 16 18:16:13.650084 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.649988    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd\" (UID: \"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:13.750778 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.750743    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd\" (UID: \"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:13.751385 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.751365    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd\" (UID: \"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:13.835325 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.835272    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:13.980640 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:13.980606    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"]
Jul 16 18:16:13.981674 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:16:13.981648    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac28efb8_982f_4d8f_bf2e_5b5fe96e4ed9.slice/crio-d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64 WatchSource:0}: Error finding container d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64: Status 404 returned error can't find the container with id d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64
Jul 16 18:16:14.088963 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:14.088914    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd" event={"ID":"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9","Type":"ContainerStarted","Data":"d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64"}
Jul 16 18:16:15.097987 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:15.097898    2577 generic.go:356] "Generic (PLEG): container finished" podID="ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9" containerID="18ea2b32adc0a2ffbbfc68d7da0d7643e900d116d451dfa3ad8102f085cf527e" exitCode=0
Jul 16 18:16:15.097987 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:15.097955    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd" event={"ID":"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9","Type":"ContainerDied","Data":"18ea2b32adc0a2ffbbfc68d7da0d7643e900d116d451dfa3ad8102f085cf527e"}
Jul 16 18:16:16.246121 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:16.246090    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:16.374192 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:16.374162    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca\") pod \"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9\" (UID: \"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9\") "
Jul 16 18:16:16.374530 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:16.374507    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9" (UID: "ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:16:16.475076 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:16.475039    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:17.112054 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:17.112023    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd"
Jul 16 18:16:17.112234 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:17.112029    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd" event={"ID":"ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9","Type":"ContainerDied","Data":"d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64"}
Jul 16 18:16:17.112234 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:17.112145    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d6d140d44c1f8aa72402905d20c3655bd0130eeb7478f0d47971e85060307c64"
Jul 16 18:16:23.578444 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.578408    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:16:23.578851 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.578684    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" podUID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" containerName="maas-api" containerID="cri-o://2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f" gracePeriod=30
Jul 16 18:16:23.599674 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.599652    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:23.606929 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.606905    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"]
Jul 16 18:16:23.610493 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.610469    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-a1a1f5-29737095-s2smz"]
Jul 16 18:16:23.846710 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.846684    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:16:23.922942 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.922909    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="677a8b30-1311-4dc7-9f27-d00b1521a408" path="/var/lib/kubelet/pods/677a8b30-1311-4dc7-9f27-d00b1521a408/volumes"
Jul 16 18:16:23.940949 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.940921    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") pod \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") "
Jul 16 18:16:23.941110 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.940980    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca\") pod \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") "
Jul 16 18:16:23.941110 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.941031    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2c5x\" (UniqueName: \"kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x\") pod \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\" (UID: \"f2c6a44f-ea92-4c0f-aece-1a565f3292ce\") "
Jul 16 18:16:23.941445 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.941409    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f2c6a44f-ea92-4c0f-aece-1a565f3292ce" (UID: "f2c6a44f-ea92-4c0f-aece-1a565f3292ce"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:16:23.943197 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.943170    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f2c6a44f-ea92-4c0f-aece-1a565f3292ce" (UID: "f2c6a44f-ea92-4c0f-aece-1a565f3292ce"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:16:23.943317 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:23.943246    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x" (OuterVolumeSpecName: "kube-api-access-k2c5x") pod "f2c6a44f-ea92-4c0f-aece-1a565f3292ce" (UID: "f2c6a44f-ea92-4c0f-aece-1a565f3292ce"). InnerVolumeSpecName "kube-api-access-k2c5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:16:24.041896 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.041860    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2c5x\" (UniqueName: \"kubernetes.io/projected/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-kube-api-access-k2c5x\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:24.042158 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.042137    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:24.042232 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.042161    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f2c6a44f-ea92-4c0f-aece-1a565f3292ce-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:24.156220 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.156187    2577 generic.go:356] "Generic (PLEG): container finished" podID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" containerID="2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f" exitCode=0
Jul 16 18:16:24.156422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.156243    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"
Jul 16 18:16:24.156422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.156274    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" event={"ID":"f2c6a44f-ea92-4c0f-aece-1a565f3292ce","Type":"ContainerDied","Data":"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"}
Jul 16 18:16:24.156422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.156352    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4" event={"ID":"f2c6a44f-ea92-4c0f-aece-1a565f3292ce","Type":"ContainerDied","Data":"fe3c1e86b46ac465aed99be3af01ab17cf12a1e8409e06bf76c6d948824c83d9"}
Jul 16 18:16:24.156422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.156378    2577 scope.go:117] "RemoveContainer" containerID="2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"
Jul 16 18:16:24.166539 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.166523    2577 scope.go:117] "RemoveContainer" containerID="2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"
Jul 16 18:16:24.166792 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:16:24.166772    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f\": container with ID starting with 2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f not found: ID does not exist" containerID="2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"
Jul 16 18:16:24.166836 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.166801    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f"} err="failed to get container status \"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f\": rpc error: code = NotFound desc = could not find container \"2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f\": container with ID starting with 2c812181a0c87db128d38bf6c95766f286612a06f2c963eeff7ea52f52ad6c2f not found: ID does not exist"
Jul 16 18:16:24.185861 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.185828    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:16:24.188912 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:24.188891    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a1a1f5-79fc49b495-n56f4"]
Jul 16 18:16:25.923732 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:25.923699    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" path="/var/lib/kubelet/pods/f2c6a44f-ea92-4c0f-aece-1a565f3292ce/volumes"
Jul 16 18:16:28.800589 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:28.800560    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:29.260115 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:29.260087    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:35.708233 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:35.708187    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:35.809758 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:35.809726    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:36.034426 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.034337    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:36.306556 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.306474    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:36.446153 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446118    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"]
Jul 16 18:16:36.446770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446753    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9" containerName="revoke-keys"
Jul 16 18:16:36.446829 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446776    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9" containerName="revoke-keys"
Jul 16 18:16:36.446829 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446822    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" containerName="maas-api"
Jul 16 18:16:36.446902 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446831    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" containerName="maas-api"
Jul 16 18:16:36.446939 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446925    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2c6a44f-ea92-4c0f-aece-1a565f3292ce" containerName="maas-api"
Jul 16 18:16:36.446973 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.446942    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9" containerName="revoke-keys"
Jul 16 18:16:36.450327 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.450284    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:36.453840 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.453816    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:16:36.456385 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.456364    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"]
Jul 16 18:16:36.549984 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.549946    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4\" (UID: \"46dee15e-369b-4437-9351-d0336254d8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:36.651176 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.651145    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4\" (UID: \"46dee15e-369b-4437-9351-d0336254d8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:36.651823 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.651801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4\" (UID: \"46dee15e-369b-4437-9351-d0336254d8e9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:36.763922 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.763889    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:36.905721 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:36.905693    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"]
Jul 16 18:16:36.908615 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:16:36.908584    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46dee15e_369b_4437_9351_d0336254d8e9.slice/crio-27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a WatchSource:0}: Error finding container 27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a: Status 404 returned error can't find the container with id 27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a
Jul 16 18:16:37.235313 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:37.235204    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4" event={"ID":"46dee15e-369b-4437-9351-d0336254d8e9","Type":"ContainerStarted","Data":"b179efc9c33431b5722ba493d2261f33cda2d2be252b2c369a9bd9af78b1a5c3"}
Jul 16 18:16:37.235313 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:37.235258    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4" event={"ID":"46dee15e-369b-4437-9351-d0336254d8e9","Type":"ContainerStarted","Data":"27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a"}
Jul 16 18:16:37.253912 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:37.253865    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4" podStartSLOduration=1.253850914 podStartE2EDuration="1.253850914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:16:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:16:37.251956773 +0000 UTC m=+2621.896179663" watchObservedRunningTime="2026-07-16 18:16:37.253850914 +0000 UTC m=+2621.898073792"
Jul 16 18:16:38.242597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:38.242569    2577 generic.go:356] "Generic (PLEG): container finished" podID="46dee15e-369b-4437-9351-d0336254d8e9" containerID="b179efc9c33431b5722ba493d2261f33cda2d2be252b2c369a9bd9af78b1a5c3" exitCode=0
Jul 16 18:16:38.242990 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:38.242661    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4" event={"ID":"46dee15e-369b-4437-9351-d0336254d8e9","Type":"ContainerDied","Data":"b179efc9c33431b5722ba493d2261f33cda2d2be252b2c369a9bd9af78b1a5c3"}
Jul 16 18:16:39.387077 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:39.387048    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:39.476970 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:39.476939    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca\") pod \"46dee15e-369b-4437-9351-d0336254d8e9\" (UID: \"46dee15e-369b-4437-9351-d0336254d8e9\") "
Jul 16 18:16:39.477324 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:39.477276    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "46dee15e-369b-4437-9351-d0336254d8e9" (UID: "46dee15e-369b-4437-9351-d0336254d8e9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:16:39.578135 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:39.578040    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/46dee15e-369b-4437-9351-d0336254d8e9-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:40.256575 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:40.256483    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4" event={"ID":"46dee15e-369b-4437-9351-d0336254d8e9","Type":"ContainerDied","Data":"27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a"}
Jul 16 18:16:40.256575 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:40.256542    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="27eb7f16357cbaa7002b8bb164fb3965e74c164cbf129bcc477f416dbfc3495a"
Jul 16 18:16:40.256575 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:40.256500    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4"
Jul 16 18:16:46.494473 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.494438    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:16:46.494990 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.494703    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" podUID="4e8737ad-f702-47b5-9622-297edba5ddb0" containerName="maas-api" containerID="cri-o://8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef" gracePeriod=30
Jul 16 18:16:46.516116 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.516084    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:46.524250 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.524220    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"]
Jul 16 18:16:46.527200 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.527178    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-28bbcf-29737095-rwf4f"]
Jul 16 18:16:46.747277 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.747215    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:16:46.842943 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.842910    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lp4fx\" (UniqueName: \"kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx\") pod \"4e8737ad-f702-47b5-9622-297edba5ddb0\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") "
Jul 16 18:16:46.843133 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.843017    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca\") pod \"4e8737ad-f702-47b5-9622-297edba5ddb0\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") "
Jul 16 18:16:46.843133 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.843047    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls\") pod \"4e8737ad-f702-47b5-9622-297edba5ddb0\" (UID: \"4e8737ad-f702-47b5-9622-297edba5ddb0\") "
Jul 16 18:16:46.843418 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.843396    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4e8737ad-f702-47b5-9622-297edba5ddb0" (UID: "4e8737ad-f702-47b5-9622-297edba5ddb0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:16:46.845069 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.845042    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4e8737ad-f702-47b5-9622-297edba5ddb0" (UID: "4e8737ad-f702-47b5-9622-297edba5ddb0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:16:46.845069 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.845044    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx" (OuterVolumeSpecName: "kube-api-access-lp4fx") pod "4e8737ad-f702-47b5-9622-297edba5ddb0" (UID: "4e8737ad-f702-47b5-9622-297edba5ddb0"). InnerVolumeSpecName "kube-api-access-lp4fx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:16:46.944733 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.944694    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4e8737ad-f702-47b5-9622-297edba5ddb0-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:46.944733 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.944729    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e8737ad-f702-47b5-9622-297edba5ddb0-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:46.944991 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:46.944747    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lp4fx\" (UniqueName: \"kubernetes.io/projected/4e8737ad-f702-47b5-9622-297edba5ddb0-kube-api-access-lp4fx\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:16:47.301602 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.301567    2577 generic.go:356] "Generic (PLEG): container finished" podID="4e8737ad-f702-47b5-9622-297edba5ddb0" containerID="8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef" exitCode=0
Jul 16 18:16:47.301602 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.301605    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"
Jul 16 18:16:47.301822 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.301647    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" event={"ID":"4e8737ad-f702-47b5-9622-297edba5ddb0","Type":"ContainerDied","Data":"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"}
Jul 16 18:16:47.301822 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.301700    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx" event={"ID":"4e8737ad-f702-47b5-9622-297edba5ddb0","Type":"ContainerDied","Data":"ad672f3061cd0024e6f94b51cd960bf5b65b2e81cbfbb67682f1940142905545"}
Jul 16 18:16:47.301822 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.301727    2577 scope.go:117] "RemoveContainer" containerID="8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"
Jul 16 18:16:47.312074 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.312055    2577 scope.go:117] "RemoveContainer" containerID="8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"
Jul 16 18:16:47.312371 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:16:47.312348    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef\": container with ID starting with 8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef not found: ID does not exist" containerID="8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"
Jul 16 18:16:47.312422 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.312381    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef"} err="failed to get container status \"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef\": rpc error: code = NotFound desc = could not find container \"8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef\": container with ID starting with 8efcf5e470ff918e916e757e7e4ae390b11dd3482a539b8c6ef3d69c36ebb6ef not found: ID does not exist"
Jul 16 18:16:47.327726 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.327699    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:16:47.338493 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.336268    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-28bbcf-64868b6dcd-s8qsx"]
Jul 16 18:16:47.922473 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.922444    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e8737ad-f702-47b5-9622-297edba5ddb0" path="/var/lib/kubelet/pods/4e8737ad-f702-47b5-9622-297edba5ddb0/volumes"
Jul 16 18:16:47.922851 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:47.922718    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8948c119-a97b-4d72-83c6-b7047cda79b3" path="/var/lib/kubelet/pods/8948c119-a97b-4d72-83c6-b7047cda79b3/volumes"
Jul 16 18:16:51.656488 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:51.656458    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:52.137469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:52.137438    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:58.484496 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:58.484461    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:58.587146 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:58.587114    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:58.809532 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:58.809441    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:59.065326 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:59.065227    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:59.467906 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:59.467875    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:16:59.852597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:16:59.852511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:00.050506 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:00.050469    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:03.246600 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.246570    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:03.343330 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.343276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:03.344577 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.344550    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:03.344984 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.344967    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46dee15e-369b-4437-9351-d0336254d8e9" containerName="revoke-keys"
Jul 16 18:17:03.345060 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.344987    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="46dee15e-369b-4437-9351-d0336254d8e9" containerName="revoke-keys"
Jul 16 18:17:03.345060 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.345021    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8737ad-f702-47b5-9622-297edba5ddb0" containerName="maas-api"
Jul 16 18:17:03.345060 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.345030    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8737ad-f702-47b5-9622-297edba5ddb0" containerName="maas-api"
Jul 16 18:17:03.345224 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.345140    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8737ad-f702-47b5-9622-297edba5ddb0" containerName="maas-api"
Jul 16 18:17:03.345224 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.345153    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="46dee15e-369b-4437-9351-d0336254d8e9" containerName="revoke-keys"
Jul 16 18:17:03.350315 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.350262    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.354042 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.354019    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-e55530-serving-cert\""
Jul 16 18:17:03.363277 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.363248    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:03.425723 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.425697    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:03.487683 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.487651    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.487683 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.487688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phlrd\" (UniqueName: \"kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.487975 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.487823    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.589454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.589347    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.589454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.589387    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phlrd\" (UniqueName: \"kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.589454 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.589454    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.589759 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:17:03.589508    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-serving-cert: secret "maas-api-e2e-api-a-e55530-serving-cert" not found
Jul 16 18:17:03.589759 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:17:03.589591    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls podName:d9325473-3269-4e05-a43f-a2f103f6afb4 nodeName:}" failed. No retries permitted until 2026-07-16 18:17:04.089571329 +0000 UTC m=+2648.733794205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls") pod "maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" (UID: "d9325473-3269-4e05-a43f-a2f103f6afb4") : secret "maas-api-e2e-api-a-e55530-serving-cert" not found
Jul 16 18:17:03.590083 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.590064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.599092 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.599060    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phlrd\" (UniqueName: \"kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:03.697980 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:03.697943    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:04.064219 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.064189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:04.094601 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.094570    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:04.097384 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.097354    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") pod \"maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:04.160484 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.160433    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:04.260916 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.260877    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:04.408499 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.408473    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:04.409264 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:17:04.409242    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9325473_3269_4e05_a43f_a2f103f6afb4.slice/crio-acae0a05a0b934dcdd87fafcebd9feb9e85af179fda32beb809a5efa933388b9 WatchSource:0}: Error finding container acae0a05a0b934dcdd87fafcebd9feb9e85af179fda32beb809a5efa933388b9: Status 404 returned error can't find the container with id acae0a05a0b934dcdd87fafcebd9feb9e85af179fda32beb809a5efa933388b9
Jul 16 18:17:04.411160 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:04.411136    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:17:05.415991 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:05.415956    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" event={"ID":"d9325473-3269-4e05-a43f-a2f103f6afb4","Type":"ContainerStarted","Data":"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"}
Jul 16 18:17:05.416436 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:05.416016    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" event={"ID":"d9325473-3269-4e05-a43f-a2f103f6afb4","Type":"ContainerStarted","Data":"acae0a05a0b934dcdd87fafcebd9feb9e85af179fda32beb809a5efa933388b9"}
Jul 16 18:17:05.416436 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:05.416166    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:05.436897 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:05.436837    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" podStartSLOduration=1.9265412039999998 podStartE2EDuration="2.436820729s" totalImagesPullingTime="510.279525ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:17:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:05.434532186 +0000 UTC m=+2650.078755065" watchObservedRunningTime="2026-07-16 18:17:05.436820729 +0000 UTC m=+2650.081043608"
Jul 16 18:17:07.828392 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:07.828358    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:08.333781 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:08.333747    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:08.646929 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:08.646876    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:08.796161 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:08.796130    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:11.235163 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.235123    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:11.331900 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.331867    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:11.382220 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.382187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:17:11.386383 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.386360    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.389087 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.389060    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-502744-serving-cert\""
Jul 16 18:17:11.397312 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.397276    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:17:11.415423 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.415399    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:11.430039 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.430014    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:11.459661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.459630    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.459828 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.459688    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpzn9\" (UniqueName: \"kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.459828 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.459739    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.561262 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.561180    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.561262 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.561259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.561538 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.561345    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpzn9\" (UniqueName: \"kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.562083 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.562064    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.563730 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.563709    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.570917 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.570894    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpzn9\" (UniqueName: \"kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9\") pod \"maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.582406 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.582385    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:11.699888 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.699852    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:11.847937 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:11.847894    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:17:11.850277 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:17:11.850199    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71a34c92_c24b_41b1_bed4_8a79e9a6ed40.slice/crio-976725eadc4d1d0cde94fad781868401d76ec34c1d4476245568c4616bb3015a WatchSource:0}: Error finding container 976725eadc4d1d0cde94fad781868401d76ec34c1d4476245568c4616bb3015a: Status 404 returned error can't find the container with id 976725eadc4d1d0cde94fad781868401d76ec34c1d4476245568c4616bb3015a
Jul 16 18:17:12.079743 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.079715    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:12.180697 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.180664    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:12.465704 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.465617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" event={"ID":"71a34c92-c24b-41b1-bed4-8a79e9a6ed40","Type":"ContainerStarted","Data":"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"}
Jul 16 18:17:12.465704 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.465677    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" event={"ID":"71a34c92-c24b-41b1-bed4-8a79e9a6ed40","Type":"ContainerStarted","Data":"976725eadc4d1d0cde94fad781868401d76ec34c1d4476245568c4616bb3015a"}
Jul 16 18:17:12.466122 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.465708    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:12.487146 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:12.487091    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" podStartSLOduration=1.105486435 podStartE2EDuration="1.487075649s" totalImagesPullingTime="381.589214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:17:12.484510326 +0000 UTC m=+2657.128733206" watchObservedRunningTime="2026-07-16 18:17:12.487075649 +0000 UTC m=+2657.131298528"
Jul 16 18:17:15.778648 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:15.778614    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:18.478494 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:18.478466    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:17:24.006504 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.006462    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"]
Jul 16 18:17:24.010524 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.010501    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:24.013261 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.013241    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:17:24.017378 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.017356    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"]
Jul 16 18:17:24.179589 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.179549    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e55530-x98sg\" (UID: \"4a37336b-f80d-4b36-acb8-c6aca38f7271\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:24.280707 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.280611    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e55530-x98sg\" (UID: \"4a37336b-f80d-4b36-acb8-c6aca38f7271\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:24.281249 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.281228    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-e55530-x98sg\" (UID: \"4a37336b-f80d-4b36-acb8-c6aca38f7271\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:24.323904 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.323869    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:24.468402 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.468370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"]
Jul 16 18:17:24.469703 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:17:24.469673    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a37336b_f80d_4b36_acb8_c6aca38f7271.slice/crio-08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227 WatchSource:0}: Error finding container 08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227: Status 404 returned error can't find the container with id 08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227
Jul 16 18:17:24.543112 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:24.543032    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg" event={"ID":"4a37336b-f80d-4b36-acb8-c6aca38f7271","Type":"ContainerStarted","Data":"08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227"}
Jul 16 18:17:25.551042 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:25.550955    2577 generic.go:356] "Generic (PLEG): container finished" podID="4a37336b-f80d-4b36-acb8-c6aca38f7271" containerID="e0822f06b0947c7d363af961ecc2e76dce0f627cd96eb0f3684a7a9ae05a2847" exitCode=0
Jul 16 18:17:25.551428 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:25.551039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg" event={"ID":"4a37336b-f80d-4b36-acb8-c6aca38f7271","Type":"ContainerDied","Data":"e0822f06b0947c7d363af961ecc2e76dce0f627cd96eb0f3684a7a9ae05a2847"}
Jul 16 18:17:26.705436 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:26.705413    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:26.802986 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:26.802940    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca\") pod \"4a37336b-f80d-4b36-acb8-c6aca38f7271\" (UID: \"4a37336b-f80d-4b36-acb8-c6aca38f7271\") "
Jul 16 18:17:26.803357 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:26.803333    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4a37336b-f80d-4b36-acb8-c6aca38f7271" (UID: "4a37336b-f80d-4b36-acb8-c6aca38f7271"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:17:26.904559 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:26.904525    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a37336b-f80d-4b36-acb8-c6aca38f7271-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:17:27.564061 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:27.564031    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg" event={"ID":"4a37336b-f80d-4b36-acb8-c6aca38f7271","Type":"ContainerDied","Data":"08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227"}
Jul 16 18:17:27.564061 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:27.564056    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-e55530-x98sg"
Jul 16 18:17:27.564303 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:27.564085    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08f8a661e6b695e9a7fff7e0f99bff9254c860d4e6bbcac6f26131e2b978d227"
Jul 16 18:17:39.067961 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.067922    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:39.068486 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.068173    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" podUID="d9325473-3269-4e05-a43f-a2f103f6afb4" containerName="maas-api" containerID="cri-o://06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287" gracePeriod=30
Jul 16 18:17:39.100806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.100766    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:39.337084 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.337059    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:39.406222 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.406186    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phlrd\" (UniqueName: \"kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd\") pod \"d9325473-3269-4e05-a43f-a2f103f6afb4\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") "
Jul 16 18:17:39.406421 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.406276    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca\") pod \"d9325473-3269-4e05-a43f-a2f103f6afb4\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") "
Jul 16 18:17:39.406469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.406427    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") pod \"d9325473-3269-4e05-a43f-a2f103f6afb4\" (UID: \"d9325473-3269-4e05-a43f-a2f103f6afb4\") "
Jul 16 18:17:39.406667 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.406639    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d9325473-3269-4e05-a43f-a2f103f6afb4" (UID: "d9325473-3269-4e05-a43f-a2f103f6afb4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:17:39.408385 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.408358    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd" (OuterVolumeSpecName: "kube-api-access-phlrd") pod "d9325473-3269-4e05-a43f-a2f103f6afb4" (UID: "d9325473-3269-4e05-a43f-a2f103f6afb4"). InnerVolumeSpecName "kube-api-access-phlrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:17:39.408498 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.408379    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d9325473-3269-4e05-a43f-a2f103f6afb4" (UID: "d9325473-3269-4e05-a43f-a2f103f6afb4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:17:39.507611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.507575    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phlrd\" (UniqueName: \"kubernetes.io/projected/d9325473-3269-4e05-a43f-a2f103f6afb4-kube-api-access-phlrd\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:17:39.507611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.507603    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d9325473-3269-4e05-a43f-a2f103f6afb4-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:17:39.507611 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.507613    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d9325473-3269-4e05-a43f-a2f103f6afb4-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:17:39.640562 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.640533    2577 generic.go:356] "Generic (PLEG): container finished" podID="d9325473-3269-4e05-a43f-a2f103f6afb4" containerID="06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287" exitCode=0
Jul 16 18:17:39.640750 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.640575    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"
Jul 16 18:17:39.640750 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.640617    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" event={"ID":"d9325473-3269-4e05-a43f-a2f103f6afb4","Type":"ContainerDied","Data":"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"}
Jul 16 18:17:39.640750 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.640680    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m" event={"ID":"d9325473-3269-4e05-a43f-a2f103f6afb4","Type":"ContainerDied","Data":"acae0a05a0b934dcdd87fafcebd9feb9e85af179fda32beb809a5efa933388b9"}
Jul 16 18:17:39.640750 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.640709    2577 scope.go:117] "RemoveContainer" containerID="06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"
Jul 16 18:17:39.650806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.650789    2577 scope.go:117] "RemoveContainer" containerID="06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"
Jul 16 18:17:39.651057 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:17:39.651035    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287\": container with ID starting with 06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287 not found: ID does not exist" containerID="06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"
Jul 16 18:17:39.651123 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.651065    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287"} err="failed to get container status \"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287\": rpc error: code = NotFound desc = could not find container \"06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287\": container with ID starting with 06bd2d5a7aa2086b28a7ca5766c619b28bf690026da55cb5ca75e24933d44287 not found: ID does not exist"
Jul 16 18:17:39.666026 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.665999    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:39.669379 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.669358    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-e55530-6b4ffb4496-9q59m"]
Jul 16 18:17:39.922928 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:39.922850    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9325473-3269-4e05-a43f-a2f103f6afb4" path="/var/lib/kubelet/pods/d9325473-3269-4e05-a43f-a2f103f6afb4/volumes"
Jul 16 18:17:44.230773 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:44.230727    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:44.661755 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:44.661722    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:51.709201 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:51.709108    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:51.810320 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:51.810276    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:52.010849 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.010752    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:52.246267 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.246233    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:17:52.383152 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383115    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"]
Jul 16 18:17:52.383771 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383752    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a37336b-f80d-4b36-acb8-c6aca38f7271" containerName="revoke-keys"
Jul 16 18:17:52.383826 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383774    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a37336b-f80d-4b36-acb8-c6aca38f7271" containerName="revoke-keys"
Jul 16 18:17:52.383826 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383790    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9325473-3269-4e05-a43f-a2f103f6afb4" containerName="maas-api"
Jul 16 18:17:52.383826 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383799    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9325473-3269-4e05-a43f-a2f103f6afb4" containerName="maas-api"
Jul 16 18:17:52.383928 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383890    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a37336b-f80d-4b36-acb8-c6aca38f7271" containerName="revoke-keys"
Jul 16 18:17:52.383928 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.383902    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9325473-3269-4e05-a43f-a2f103f6afb4" containerName="maas-api"
Jul 16 18:17:52.388806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.388785    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:52.392277 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.392257    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:17:52.395018 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.394992    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"]
Jul 16 18:17:52.423040 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.422999    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-502744-4zpg4\" (UID: \"ab982314-82e3-45d0-9821-dce24ac03802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:52.524356 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.524320    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-502744-4zpg4\" (UID: \"ab982314-82e3-45d0-9821-dce24ac03802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:52.524949 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.524927    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-502744-4zpg4\" (UID: \"ab982314-82e3-45d0-9821-dce24ac03802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:52.702054 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.701969    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:52.839563 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:52.839539    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"]
Jul 16 18:17:52.841796 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:17:52.841760    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811 WatchSource:0}: Error finding container ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811: Status 404 returned error can't find the container with id ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811
Jul 16 18:17:53.736155 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:53.736118    2577 generic.go:356] "Generic (PLEG): container finished" podID="ab982314-82e3-45d0-9821-dce24ac03802" containerID="ea9dfcbfb64337f9cd3bad755eb7076172fd09e7f6008d49f5dba07059203e19" exitCode=0
Jul 16 18:17:53.736387 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:53.736216    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4" event={"ID":"ab982314-82e3-45d0-9821-dce24ac03802","Type":"ContainerDied","Data":"ea9dfcbfb64337f9cd3bad755eb7076172fd09e7f6008d49f5dba07059203e19"}
Jul 16 18:17:53.736387 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:53.736270    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4" event={"ID":"ab982314-82e3-45d0-9821-dce24ac03802","Type":"ContainerStarted","Data":"ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811"}
Jul 16 18:17:54.879675 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:54.879652    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:54.945830 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:54.945797    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca\") pod \"ab982314-82e3-45d0-9821-dce24ac03802\" (UID: \"ab982314-82e3-45d0-9821-dce24ac03802\") "
Jul 16 18:17:54.946172 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:54.946150    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ab982314-82e3-45d0-9821-dce24ac03802" (UID: "ab982314-82e3-45d0-9821-dce24ac03802"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:17:55.047162 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:55.047055    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ab982314-82e3-45d0-9821-dce24ac03802-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:17:55.749015 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:55.748987    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4"
Jul 16 18:17:55.749193 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:55.748985    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-502744-4zpg4" event={"ID":"ab982314-82e3-45d0-9821-dce24ac03802","Type":"ContainerDied","Data":"ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811"}
Jul 16 18:17:55.749193 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:55.749101    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811"
Jul 16 18:17:56.083250 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:56.083163    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:17:56.086036 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:56.086016    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:17:56.093461 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:56.093441    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:17:56.096105 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:17:56.096088    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:18:03.047594 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:03.047552    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:04.185271 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:04.185231    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:07.418850 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.418809    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:18:07.419277 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.419091    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" podUID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" containerName="maas-api" containerID="cri-o://2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1" gracePeriod=30
Jul 16 18:18:07.439548 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.439517    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:07.673736 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.673672    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:18:07.755043 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.755012    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls\") pod \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") "
Jul 16 18:18:07.755209 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.755078    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca\") pod \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") "
Jul 16 18:18:07.755209 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.755114    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpzn9\" (UniqueName: \"kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9\") pod \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\" (UID: \"71a34c92-c24b-41b1-bed4-8a79e9a6ed40\") "
Jul 16 18:18:07.755479 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.755455    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "71a34c92-c24b-41b1-bed4-8a79e9a6ed40" (UID: "71a34c92-c24b-41b1-bed4-8a79e9a6ed40"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:18:07.757193 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.757166    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "71a34c92-c24b-41b1-bed4-8a79e9a6ed40" (UID: "71a34c92-c24b-41b1-bed4-8a79e9a6ed40"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:18:07.757321 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.757209    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9" (OuterVolumeSpecName: "kube-api-access-xpzn9") pod "71a34c92-c24b-41b1-bed4-8a79e9a6ed40" (UID: "71a34c92-c24b-41b1-bed4-8a79e9a6ed40"). InnerVolumeSpecName "kube-api-access-xpzn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:18:07.821994 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.821960    2577 generic.go:356] "Generic (PLEG): container finished" podID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" containerID="2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1" exitCode=0
Jul 16 18:18:07.822159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.822006    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"
Jul 16 18:18:07.822159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.822039    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" event={"ID":"71a34c92-c24b-41b1-bed4-8a79e9a6ed40","Type":"ContainerDied","Data":"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"}
Jul 16 18:18:07.822159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.822093    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9" event={"ID":"71a34c92-c24b-41b1-bed4-8a79e9a6ed40","Type":"ContainerDied","Data":"976725eadc4d1d0cde94fad781868401d76ec34c1d4476245568c4616bb3015a"}
Jul 16 18:18:07.822159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.822116    2577 scope.go:117] "RemoveContainer" containerID="2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"
Jul 16 18:18:07.833246 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.833225    2577 scope.go:117] "RemoveContainer" containerID="2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"
Jul 16 18:18:07.833577 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:07.833559    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1\": container with ID starting with 2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1 not found: ID does not exist" containerID="2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"
Jul 16 18:18:07.833644 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.833587    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1"} err="failed to get container status \"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1\": rpc error: code = NotFound desc = could not find container \"2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1\": container with ID starting with 2c2a77c22f1d9a3e43b53a6e1aaf8e5927c2b389059555da3a617c09ee87e3d1 not found: ID does not exist"
Jul 16 18:18:07.852039 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.852010    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:18:07.856163 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.856136    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:18:07.856163 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.856165    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:18:07.856376 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.856176    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpzn9\" (UniqueName: \"kubernetes.io/projected/71a34c92-c24b-41b1-bed4-8a79e9a6ed40-kube-api-access-xpzn9\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:18:07.857883 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.857862    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-502744-6b9fd9955d-p7pr9"]
Jul 16 18:18:07.922536 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:07.922497    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" path="/var/lib/kubelet/pods/71a34c92-c24b-41b1-bed4-8a79e9a6ed40/volumes"
Jul 16 18:18:12.559591 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:12.559549    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:12.978670 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:12.978639    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:14.234741 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:14.234704    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:18.005227 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:18.005184    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:18.130187 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:18.130098    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:18.131369 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:18.131233    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:19.386146 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:19.386103    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:19.483623 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:19.483581    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:19.676098 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:19.676021    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:19.914464 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:19.914430    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:20.285072 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:20.285039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:20.612209 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:20.612118    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:20.929593 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:20.929562    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:23.523946 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.523904    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:23.622746 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.622711    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:23.671032 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671003    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:18:23.671612 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671595    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab982314-82e3-45d0-9821-dce24ac03802" containerName="revoke-keys"
Jul 16 18:18:23.671661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671615    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab982314-82e3-45d0-9821-dce24ac03802" containerName="revoke-keys"
Jul 16 18:18:23.671661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671643    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" containerName="maas-api"
Jul 16 18:18:23.671661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671652    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" containerName="maas-api"
Jul 16 18:18:23.671769 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671757    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab982314-82e3-45d0-9821-dce24ac03802" containerName="revoke-keys"
Jul 16 18:18:23.671813 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.671774    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="71a34c92-c24b-41b1-bed4-8a79e9a6ed40" containerName="maas-api"
Jul 16 18:18:23.676562 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.676543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.679303 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.679268    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-a0389e-serving-cert\""
Jul 16 18:18:23.685754 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.685721    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:18:23.723756 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.723720    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:23.797595 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.797503    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.797595 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.797542    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.797595 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.797581    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qgkk\" (UniqueName: \"kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.822807 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.822775    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:23.898932 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.898893    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qgkk\" (UniqueName: \"kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.899156 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.899015    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.899156 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.899041    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.899686 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.899666    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.901507 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.901488    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.908261 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.908237    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qgkk\" (UniqueName: \"kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk\") pod \"maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:23.989187 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:23.989148    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:24.148246 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.148221    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:18:24.149154 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:18:24.149124    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa6b8bbf_f9ce_4e22_acbf_8dcba0c6602a.slice/crio-31e0bdc3ecadd36e70936874fed28673e9e373fbbb23bb2678a14d3b2cf1ea02 WatchSource:0}: Error finding container 31e0bdc3ecadd36e70936874fed28673e9e373fbbb23bb2678a14d3b2cf1ea02: Status 404 returned error can't find the container with id 31e0bdc3ecadd36e70936874fed28673e9e373fbbb23bb2678a14d3b2cf1ea02
Jul 16 18:18:24.271957 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.271881    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:24.286329 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:24.286282    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:24.360582 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.360473    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:24.927711 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.927615    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" event={"ID":"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a","Type":"ContainerStarted","Data":"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"}
Jul 16 18:18:24.928240 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.927732    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:24.928240 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.927757    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" event={"ID":"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a","Type":"ContainerStarted","Data":"31e0bdc3ecadd36e70936874fed28673e9e373fbbb23bb2678a14d3b2cf1ea02"}
Jul 16 18:18:24.947034 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:24.946978    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" podStartSLOduration=1.560504672 podStartE2EDuration="1.946958945s" totalImagesPullingTime="386.454273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:18:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:18:24.946491341 +0000 UTC m=+2729.590714219" watchObservedRunningTime="2026-07-16 18:18:24.946958945 +0000 UTC m=+2729.591181824"
Jul 16 18:18:28.111694 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:28.111654    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:28.490485 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:28.490454    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:28.837086 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:28.837001    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:29.036150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:29.036118    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:29.184981 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:29.184949    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:29.255160 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:29.255126    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:30.939762 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:30.939735    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:18:31.571554 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.571509    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:31.655590 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.655559    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:18:31.658865 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.658834    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:31.660348 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.660323    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.663234 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.663215    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-bc54de-serving-cert\""
Jul 16 18:18:31.667151 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.667121    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:18:31.667926 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.667905    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.668052 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.667948    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xzqj\" (UniqueName: \"kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.668052 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.667987    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.739942 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.739908    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:31.768341 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.768304    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.768512 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.768372    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xzqj\" (UniqueName: \"kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.768512 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.768424    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.768595 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:31.768564    2577 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-serving-cert: secret "maas-api-e2e-shared-b-bc54de-serving-cert" not found
Jul 16 18:18:31.768658 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:31.768645    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls podName:18c4601a-ad47-4655-8762-6af6b828120a nodeName:}" failed. No retries permitted until 2026-07-16 18:18:32.268621929 +0000 UTC m=+2736.912844786 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls") pod "maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" (UID: "18c4601a-ad47-4655-8762-6af6b828120a") : secret "maas-api-e2e-shared-b-bc54de-serving-cert" not found
Jul 16 18:18:31.769031 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.769015    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.778390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.778361    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xzqj\" (UniqueName: \"kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:31.903969 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:31.903931    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:32.272445 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.272343    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:32.274837 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.274812    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") pod \"maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:32.274987 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.274970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:32.306893 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.306861    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:32.411068 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.411039    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:32.430209 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.430171    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:18:32.430807 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:18:32.430784    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c4601a_ad47_4655_8762_6af6b828120a.slice/crio-7e7747633b25a18d0b6a2ab054d3f4e367738c2f6dd509b98ba66cb10b2c2289 WatchSource:0}: Error finding container 7e7747633b25a18d0b6a2ab054d3f4e367738c2f6dd509b98ba66cb10b2c2289: Status 404 returned error can't find the container with id 7e7747633b25a18d0b6a2ab054d3f4e367738c2f6dd509b98ba66cb10b2c2289
Jul 16 18:18:32.979186 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.979153    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" event={"ID":"18c4601a-ad47-4655-8762-6af6b828120a","Type":"ContainerStarted","Data":"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"}
Jul 16 18:18:32.979386 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.979215    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" event={"ID":"18c4601a-ad47-4655-8762-6af6b828120a","Type":"ContainerStarted","Data":"7e7747633b25a18d0b6a2ab054d3f4e367738c2f6dd509b98ba66cb10b2c2289"}
Jul 16 18:18:32.979386 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:32.979245    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:33.002014 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:33.001953    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" podStartSLOduration=1.615723346 podStartE2EDuration="2.001932311s" totalImagesPullingTime="386.208965ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:18:32.998616318 +0000 UTC m=+2737.642839193" watchObservedRunningTime="2026-07-16 18:18:33.001932311 +0000 UTC m=+2737.646155226"
Jul 16 18:18:33.043977 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:33.043944    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:34.296601 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:34.296560    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:36.135715 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:36.135681    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:38.992600 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:38.992569    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:18:44.306576 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:44.306540    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:45.327668 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:45.327633    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:45.425326 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:45.425282    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:48.040114 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:48.040078    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:53.214385 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:53.214348    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:53.313505 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:53.313477    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:18:54.355017 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:18:54.354977    2577 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice/crio-ca135e9160a2c4f79ee5fd4609e6c2d2ff8128d6cd0ba4eee90ddd06d0e48811\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab982314_82e3_45d0_9821_dce24ac03802.slice\": RecentStats: unable to find data in memory cache]"
Jul 16 18:18:54.924244 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:18:54.924210    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:19:11.941949 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:19:11.941916    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:20:39.881863 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:20:39.881832    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:20:39.981489 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:20:39.981448    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:21:33.139811 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:21:33.139780    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:21:34.011221 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:21:34.011188    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:21:41.134820 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:21:41.134787    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:21:56.321251 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:21:56.321214    2577 scope.go:117] "RemoveContainer" containerID="7c7041195658c52e6fe36eb2f7f5497e70f7e2b47006b676f039e57c7bfa20b9"
Jul 16 18:21:56.331065 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:21:56.331044    2577 scope.go:117] "RemoveContainer" containerID="cffec38a5b55735def10472141bf8c811f2d433a0c6c58de5678c9d5beee833b"
Jul 16 18:22:05.691846 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:05.691816    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:20.860587 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:20.860511    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:24.382900 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:24.382865    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:46.119224 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:46.119189    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:46.217111 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:46.217074    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:50.705935 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:50.705886    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:51.628637 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:51.628583    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:22:56.126370 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:56.126324    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:22:56.129662 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:56.129639    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:22:56.139765 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:56.139745    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:22:56.142505 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:22:56.142486    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8bk6d_a5a0d4fd-dc77-45cd-bca0-919bcbf3e89c/ovn-acl-logging/0.log"
Jul 16 18:23:04.911367 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:04.911336    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:23:43.926747 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:43.926710    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:23:46.244311 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:46.244232    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:23:46.344581 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:46.344515    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:23:54.178370 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:54.178274    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:23:54.366753 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:23:54.366722    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:24:24.223478 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:24.223447    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:24:25.101774 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:25.101736    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:24:26.261176 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.261144    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147848375344"]
Jul 16 18:24:26.265582 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.265563    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:26.268349 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.268326    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-f8nxn\""
Jul 16 18:24:26.269755 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.269732    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147848375344"]
Jul 16 18:24:26.398124 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.398090    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84rc9\" (UniqueName: \"kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9\") pod \"test-curl-7596-140147848375344\" (UID: \"7de445ba-772b-4b07-99f0-ef223204a49c\") " pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:26.499513 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.499485    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84rc9\" (UniqueName: \"kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9\") pod \"test-curl-7596-140147848375344\" (UID: \"7de445ba-772b-4b07-99f0-ef223204a49c\") " pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:26.511875 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.511801    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84rc9\" (UniqueName: \"kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9\") pod \"test-curl-7596-140147848375344\" (UID: \"7de445ba-772b-4b07-99f0-ef223204a49c\") " pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:26.576472 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.576431    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:26.726270 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.726241    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147848375344"]
Jul 16 18:24:26.727715 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:26.727667    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7de445ba_772b_4b07_99f0_ef223204a49c.slice/crio-21b67fd2aa55c0a30ba61400781a3d9ddcc6c3e34b18161a1b62aff2d1897600 WatchSource:0}: Error finding container 21b67fd2aa55c0a30ba61400781a3d9ddcc6c3e34b18161a1b62aff2d1897600: Status 404 returned error can't find the container with id 21b67fd2aa55c0a30ba61400781a3d9ddcc6c3e34b18161a1b62aff2d1897600
Jul 16 18:24:26.729173 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:26.729152    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 16 18:24:27.192977 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:27.192939    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147848375344" event={"ID":"7de445ba-772b-4b07-99f0-ef223204a49c","Type":"ContainerStarted","Data":"21b67fd2aa55c0a30ba61400781a3d9ddcc6c3e34b18161a1b62aff2d1897600"}
Jul 16 18:24:28.200762 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:28.200725    2577 generic.go:356] "Generic (PLEG): container finished" podID="7de445ba-772b-4b07-99f0-ef223204a49c" containerID="d5bb3ec57570d04eafcbe9691ec5be7f7a6397553c8000e9a175216e3fb5769d" exitCode=0
Jul 16 18:24:28.201155 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:28.200774    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147848375344" event={"ID":"7de445ba-772b-4b07-99f0-ef223204a49c","Type":"ContainerDied","Data":"d5bb3ec57570d04eafcbe9691ec5be7f7a6397553c8000e9a175216e3fb5769d"}
Jul 16 18:24:29.346953 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.346928    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:29.370321 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.370282    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147848375344_7de445ba-772b-4b07-99f0-ef223204a49c/test-curl-7596-140147848375344/0.log"
Jul 16 18:24:29.393866 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.393836    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147848375344"]
Jul 16 18:24:29.399688 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.399664    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147848375344"]
Jul 16 18:24:29.425925 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.425902    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84rc9\" (UniqueName: \"kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9\") pod \"7de445ba-772b-4b07-99f0-ef223204a49c\" (UID: \"7de445ba-772b-4b07-99f0-ef223204a49c\") "
Jul 16 18:24:29.427955 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.427927    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9" (OuterVolumeSpecName: "kube-api-access-84rc9") pod "7de445ba-772b-4b07-99f0-ef223204a49c" (UID: "7de445ba-772b-4b07-99f0-ef223204a49c"). InnerVolumeSpecName "kube-api-access-84rc9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:29.526856 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.526784    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84rc9\" (UniqueName: \"kubernetes.io/projected/7de445ba-772b-4b07-99f0-ef223204a49c-kube-api-access-84rc9\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:29.530650 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.530623    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147848376112"]
Jul 16 18:24:29.531032 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.531020    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7de445ba-772b-4b07-99f0-ef223204a49c" containerName="test-curl-7596-140147848375344"
Jul 16 18:24:29.531081 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.531034    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7de445ba-772b-4b07-99f0-ef223204a49c" containerName="test-curl-7596-140147848375344"
Jul 16 18:24:29.531117 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.531095    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7de445ba-772b-4b07-99f0-ef223204a49c" containerName="test-curl-7596-140147848375344"
Jul 16 18:24:29.534270 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.534254    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:29.539320 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.539281    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147848376112"]
Jul 16 18:24:29.627471 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.627437    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnr79\" (UniqueName: \"kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79\") pod \"test-curl-7596-140147848376112\" (UID: \"3643473f-e387-4f5d-a535-e2645d383f3e\") " pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:29.728734 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.728702    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnr79\" (UniqueName: \"kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79\") pod \"test-curl-7596-140147848376112\" (UID: \"3643473f-e387-4f5d-a535-e2645d383f3e\") " pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:29.738074 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.738041    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnr79\" (UniqueName: \"kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79\") pod \"test-curl-7596-140147848376112\" (UID: \"3643473f-e387-4f5d-a535-e2645d383f3e\") " pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:29.844332 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.844224    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:29.923722 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.923691    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7de445ba-772b-4b07-99f0-ef223204a49c" path="/var/lib/kubelet/pods/7de445ba-772b-4b07-99f0-ef223204a49c/volumes"
Jul 16 18:24:29.985124 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:29.985097    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147848376112"]
Jul 16 18:24:29.986917 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:29.986889    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3643473f_e387_4f5d_a535_e2645d383f3e.slice/crio-0db363a489e6ad9c21c43c1860588bf107b5811e04c9d8f18f6ea89011531094 WatchSource:0}: Error finding container 0db363a489e6ad9c21c43c1860588bf107b5811e04c9d8f18f6ea89011531094: Status 404 returned error can't find the container with id 0db363a489e6ad9c21c43c1860588bf107b5811e04c9d8f18f6ea89011531094
Jul 16 18:24:30.213756 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:30.213723    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147848376112" event={"ID":"3643473f-e387-4f5d-a535-e2645d383f3e","Type":"ContainerStarted","Data":"0db363a489e6ad9c21c43c1860588bf107b5811e04c9d8f18f6ea89011531094"}
Jul 16 18:24:30.215126 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:30.215103    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848375344"
Jul 16 18:24:30.215236 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:30.215141    2577 scope.go:117] "RemoveContainer" containerID="d5bb3ec57570d04eafcbe9691ec5be7f7a6397553c8000e9a175216e3fb5769d"
Jul 16 18:24:31.222502 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:31.222468    2577 generic.go:356] "Generic (PLEG): container finished" podID="3643473f-e387-4f5d-a535-e2645d383f3e" containerID="d8fa2affdbc1ed9fe2508c94176e88c9f59dfacd63469777ac168303af35b23e" exitCode=0
Jul 16 18:24:31.222950 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:31.222555    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147848376112" event={"ID":"3643473f-e387-4f5d-a535-e2645d383f3e","Type":"ContainerDied","Data":"d8fa2affdbc1ed9fe2508c94176e88c9f59dfacd63469777ac168303af35b23e"}
Jul 16 18:24:32.369334 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.369309    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:32.392952 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.392924    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147848376112_3643473f-e387-4f5d-a535-e2645d383f3e/test-curl-7596-140147848376112/0.log"
Jul 16 18:24:32.420498 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.420463    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147848376112"]
Jul 16 18:24:32.423911 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.423888    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147848376112"]
Jul 16 18:24:32.450351 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.450331    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnr79\" (UniqueName: \"kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79\") pod \"3643473f-e387-4f5d-a535-e2645d383f3e\" (UID: \"3643473f-e387-4f5d-a535-e2645d383f3e\") "
Jul 16 18:24:32.452369 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.452345    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79" (OuterVolumeSpecName: "kube-api-access-dnr79") pod "3643473f-e387-4f5d-a535-e2645d383f3e" (UID: "3643473f-e387-4f5d-a535-e2645d383f3e"). InnerVolumeSpecName "kube-api-access-dnr79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:32.551105 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.551022    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnr79\" (UniqueName: \"kubernetes.io/projected/3643473f-e387-4f5d-a535-e2645d383f3e-kube-api-access-dnr79\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:32.593390 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.593358    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:32.593768 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.593755    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3643473f-e387-4f5d-a535-e2645d383f3e" containerName="test-curl-7596-140147848376112"
Jul 16 18:24:32.593815 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.593769    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="3643473f-e387-4f5d-a535-e2645d383f3e" containerName="test-curl-7596-140147848376112"
Jul 16 18:24:32.593860 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.593852    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="3643473f-e387-4f5d-a535-e2645d383f3e" containerName="test-curl-7596-140147848376112"
Jul 16 18:24:32.596979 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.596960    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:32.605339 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.605312    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:32.752507 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.752471    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4x6h\" (UniqueName: \"kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h\") pod \"test-curl-7596-140147846292800\" (UID: \"7ac60cb8-3a7e-4165-b604-6b99220575f4\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:32.853909 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.853822    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4x6h\" (UniqueName: \"kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h\") pod \"test-curl-7596-140147846292800\" (UID: \"7ac60cb8-3a7e-4165-b604-6b99220575f4\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:32.863764 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.863739    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4x6h\" (UniqueName: \"kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h\") pod \"test-curl-7596-140147846292800\" (UID: \"7ac60cb8-3a7e-4165-b604-6b99220575f4\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:32.907552 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:32.907518    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:33.053605 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:33.053577    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7ac60cb8_3a7e_4165_b604_6b99220575f4.slice/crio-66d7b72215c9eef8206bcc291146f1185817c017d5cab443701fe006c3ba469f WatchSource:0}: Error finding container 66d7b72215c9eef8206bcc291146f1185817c017d5cab443701fe006c3ba469f: Status 404 returned error can't find the container with id 66d7b72215c9eef8206bcc291146f1185817c017d5cab443701fe006c3ba469f
Jul 16 18:24:33.055002 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:33.054974    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:33.237255 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:33.237228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:33.237468 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:33.237231    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0db363a489e6ad9c21c43c1860588bf107b5811e04c9d8f18f6ea89011531094"
Jul 16 18:24:33.238781 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:33.238745    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846292800" event={"ID":"7ac60cb8-3a7e-4165-b604-6b99220575f4","Type":"ContainerStarted","Data":"66d7b72215c9eef8206bcc291146f1185817c017d5cab443701fe006c3ba469f"}
Jul 16 18:24:33.248222 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:24:33.248198    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7596-140147848376112\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="3643473f-e387-4f5d-a535-e2645d383f3e" pod="opendatahub/test-curl-7596-140147848376112"
Jul 16 18:24:33.923442 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:33.923410    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3643473f-e387-4f5d-a535-e2645d383f3e" path="/var/lib/kubelet/pods/3643473f-e387-4f5d-a535-e2645d383f3e/volumes"
Jul 16 18:24:34.246777 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:34.246686    2577 generic.go:356] "Generic (PLEG): container finished" podID="7ac60cb8-3a7e-4165-b604-6b99220575f4" containerID="9d3b998e7236d1249fd99ea1bddcd87b23e8c92ef275fb03044054f550a1a332" exitCode=0
Jul 16 18:24:34.246777 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:34.246729    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846292800" event={"ID":"7ac60cb8-3a7e-4165-b604-6b99220575f4","Type":"ContainerDied","Data":"9d3b998e7236d1249fd99ea1bddcd87b23e8c92ef275fb03044054f550a1a332"}
Jul 16 18:24:35.394081 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.394053    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.421755 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.421727    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147846292800_7ac60cb8-3a7e-4165-b604-6b99220575f4/test-curl-7596-140147846292800/0.log"
Jul 16 18:24:35.449526 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.449496    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:35.452875 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.452854    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:35.476595 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.476574    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j4x6h\" (UniqueName: \"kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h\") pod \"7ac60cb8-3a7e-4165-b604-6b99220575f4\" (UID: \"7ac60cb8-3a7e-4165-b604-6b99220575f4\") "
Jul 16 18:24:35.478625 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.478601    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h" (OuterVolumeSpecName: "kube-api-access-j4x6h") pod "7ac60cb8-3a7e-4165-b604-6b99220575f4" (UID: "7ac60cb8-3a7e-4165-b604-6b99220575f4"). InnerVolumeSpecName "kube-api-access-j4x6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:35.577844 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.577776    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j4x6h\" (UniqueName: \"kubernetes.io/projected/7ac60cb8-3a7e-4165-b604-6b99220575f4-kube-api-access-j4x6h\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:35.590406 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.590378    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:35.590800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.590787    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ac60cb8-3a7e-4165-b604-6b99220575f4" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:35.590849 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.590802    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ac60cb8-3a7e-4165-b604-6b99220575f4" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:35.590897 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.590888    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ac60cb8-3a7e-4165-b604-6b99220575f4" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:35.594030 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.594015    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.608647 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.608620    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:35.678641 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.678610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mktx4\" (UniqueName: \"kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4\") pod \"test-curl-7596-140147846292800\" (UID: \"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.779225 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.779194    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mktx4\" (UniqueName: \"kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4\") pod \"test-curl-7596-140147846292800\" (UID: \"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.789667 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.789638    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mktx4\" (UniqueName: \"kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4\") pod \"test-curl-7596-140147846292800\" (UID: \"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620\") " pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.902416 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.902385    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:35.923661 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:35.923592    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ac60cb8-3a7e-4165-b604-6b99220575f4" path="/var/lib/kubelet/pods/7ac60cb8-3a7e-4165-b604-6b99220575f4/volumes"
Jul 16 18:24:36.056442 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:36.056416    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:36.057808 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:36.057787    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dcef269_ca8c_4e52_93f8_f6ea2dfaa620.slice/crio-5e19e7af3ee1da939499e22cff1fd88f5ec04970982f979e1cd38c3e038a3487 WatchSource:0}: Error finding container 5e19e7af3ee1da939499e22cff1fd88f5ec04970982f979e1cd38c3e038a3487: Status 404 returned error can't find the container with id 5e19e7af3ee1da939499e22cff1fd88f5ec04970982f979e1cd38c3e038a3487
Jul 16 18:24:36.260776 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:36.260694    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846292800" event={"ID":"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620","Type":"ContainerStarted","Data":"5e19e7af3ee1da939499e22cff1fd88f5ec04970982f979e1cd38c3e038a3487"}
Jul 16 18:24:36.261913 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:36.261889    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:36.262032 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:36.261888    2577 scope.go:117] "RemoveContainer" containerID="9d3b998e7236d1249fd99ea1bddcd87b23e8c92ef275fb03044054f550a1a332"
Jul 16 18:24:37.270309 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:37.270256    2577 generic.go:356] "Generic (PLEG): container finished" podID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" containerID="ce0b1daa9e1edec6f233119420a9b3bd01780325e375ebe2e1825f957ed9262c" exitCode=0
Jul 16 18:24:37.270760 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:37.270339    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846292800" event={"ID":"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620","Type":"ContainerDied","Data":"ce0b1daa9e1edec6f233119420a9b3bd01780325e375ebe2e1825f957ed9262c"}
Jul 16 18:24:38.415834 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.415813    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:38.442477 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.442448    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147846292800_8dcef269-ca8c-4e52-93f8-f6ea2dfaa620/test-curl-7596-140147846292800/0.log"
Jul 16 18:24:38.470578 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.470553    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:38.475151 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.475131    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147846292800"]
Jul 16 18:24:38.502147 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.502128    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mktx4\" (UniqueName: \"kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4\") pod \"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620\" (UID: \"8dcef269-ca8c-4e52-93f8-f6ea2dfaa620\") "
Jul 16 18:24:38.504114 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.504086    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4" (OuterVolumeSpecName: "kube-api-access-mktx4") pod "8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" (UID: "8dcef269-ca8c-4e52-93f8-f6ea2dfaa620"). InnerVolumeSpecName "kube-api-access-mktx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:38.603013 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.602939    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mktx4\" (UniqueName: \"kubernetes.io/projected/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620-kube-api-access-mktx4\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:38.603588 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.603569    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:38.603977 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.603964    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:38.604017 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.603980    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:38.604101 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.604090    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" containerName="test-curl-7596-140147846292800"
Jul 16 18:24:38.607450 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.607435    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:38.620062 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.620039    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:38.704059 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.704029    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9gmz\" (UniqueName: \"kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz\") pod \"test-curl-7596-140147846293808\" (UID: \"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:38.805018 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.804983    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9gmz\" (UniqueName: \"kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz\") pod \"test-curl-7596-140147846293808\" (UID: \"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:38.815587 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.815558    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9gmz\" (UniqueName: \"kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz\") pod \"test-curl-7596-140147846293808\" (UID: \"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:38.915690 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:38.915654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:39.059144 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:39.059110    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:39.060127 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:39.060100    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45d6bd8a_aefa_48b8_a4ea_cc6b5c21dc14.slice/crio-6fdae677cdc25d4a32900123659693844748c18ab40c67b970e07e268c64f71e WatchSource:0}: Error finding container 6fdae677cdc25d4a32900123659693844748c18ab40c67b970e07e268c64f71e: Status 404 returned error can't find the container with id 6fdae677cdc25d4a32900123659693844748c18ab40c67b970e07e268c64f71e
Jul 16 18:24:39.283676 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:39.283587    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846293808" event={"ID":"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14","Type":"ContainerStarted","Data":"6fdae677cdc25d4a32900123659693844748c18ab40c67b970e07e268c64f71e"}
Jul 16 18:24:39.285017 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:39.284994    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:39.285017 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:39.285004    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e19e7af3ee1da939499e22cff1fd88f5ec04970982f979e1cd38c3e038a3487"
Jul 16 18:24:39.295860 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:24:39.295832    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7596-140147846292800\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" pod="opendatahub/test-curl-7596-140147846292800"
Jul 16 18:24:39.922996 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:39.922961    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dcef269-ca8c-4e52-93f8-f6ea2dfaa620" path="/var/lib/kubelet/pods/8dcef269-ca8c-4e52-93f8-f6ea2dfaa620/volumes"
Jul 16 18:24:40.292970 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:40.292879    2577 generic.go:356] "Generic (PLEG): container finished" podID="45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" containerID="f296c8f8c4230de76420b8742644bb913681bdee3db6c957e9227f032c796315" exitCode=0
Jul 16 18:24:40.292970 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:40.292936    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846293808" event={"ID":"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14","Type":"ContainerDied","Data":"f296c8f8c4230de76420b8742644bb913681bdee3db6c957e9227f032c796315"}
Jul 16 18:24:41.447829 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.447803    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:41.470615 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.470592    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147846293808_45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14/test-curl-7596-140147846293808/0.log"
Jul 16 18:24:41.499200 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.499170    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:41.503367 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.503348    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:41.530274 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.530250    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9gmz\" (UniqueName: \"kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz\") pod \"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14\" (UID: \"45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14\") "
Jul 16 18:24:41.532225 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.532202    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz" (OuterVolumeSpecName: "kube-api-access-x9gmz") pod "45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" (UID: "45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14"). InnerVolumeSpecName "kube-api-access-x9gmz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:41.631074 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.631045    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9gmz\" (UniqueName: \"kubernetes.io/projected/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14-kube-api-access-x9gmz\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:41.634989 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.634960    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:41.635506 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.635486    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:41.635605 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.635508    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:41.635673 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.635629    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:41.638659 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.638643    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:41.644900 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.644878    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:41.731985 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.731952    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-974sj\" (UniqueName: \"kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj\") pod \"test-curl-7596-140147846293808\" (UID: \"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:41.833139 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.833098    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-974sj\" (UniqueName: \"kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj\") pod \"test-curl-7596-140147846293808\" (UID: \"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:41.842954 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.842925    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-974sj\" (UniqueName: \"kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj\") pod \"test-curl-7596-140147846293808\" (UID: \"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9\") " pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:41.923512 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.923435    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14" path="/var/lib/kubelet/pods/45d6bd8a-aefa-48b8-a4ea-cc6b5c21dc14/volumes"
Jul 16 18:24:41.948438 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:41.948415    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:42.084958 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:42.084933    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:42.087019 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:42.086996    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f3eec28_cb58_4b2c_a83d_fc771e0de8b9.slice/crio-76cd1804353a9757a08ee4a3ea16c81663ed21aa6a0ee19204f5beb489e7427e WatchSource:0}: Error finding container 76cd1804353a9757a08ee4a3ea16c81663ed21aa6a0ee19204f5beb489e7427e: Status 404 returned error can't find the container with id 76cd1804353a9757a08ee4a3ea16c81663ed21aa6a0ee19204f5beb489e7427e
Jul 16 18:24:42.306371 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:42.306259    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846293808" event={"ID":"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9","Type":"ContainerStarted","Data":"76cd1804353a9757a08ee4a3ea16c81663ed21aa6a0ee19204f5beb489e7427e"}
Jul 16 18:24:42.307573 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:42.307552    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:42.307720 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:42.307608    2577 scope.go:117] "RemoveContainer" containerID="f296c8f8c4230de76420b8742644bb913681bdee3db6c957e9227f032c796315"
Jul 16 18:24:43.315694 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:43.315656    2577 generic.go:356] "Generic (PLEG): container finished" podID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" containerID="c4926ddc5ae2f9dbb9ca7d1b05d48a51f2c12694b7594ec7949208c0e307dc99" exitCode=0
Jul 16 18:24:43.316102 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:43.315742    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7596-140147846293808" event={"ID":"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9","Type":"ContainerDied","Data":"c4926ddc5ae2f9dbb9ca7d1b05d48a51f2c12694b7594ec7949208c0e307dc99"}
Jul 16 18:24:44.469038 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.469015    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:44.520270 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.520244    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7596-140147846293808_7f3eec28-cb58-4b2c-a83d-fc771e0de8b9/test-curl-7596-140147846293808/0.log"
Jul 16 18:24:44.552252 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.552222    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:44.559148 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.559125    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-974sj\" (UniqueName: \"kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj\") pod \"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9\" (UID: \"7f3eec28-cb58-4b2c-a83d-fc771e0de8b9\") "
Jul 16 18:24:44.560210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.560189    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7596-140147846293808"]
Jul 16 18:24:44.561224 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.561196    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj" (OuterVolumeSpecName: "kube-api-access-974sj") pod "7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" (UID: "7f3eec28-cb58-4b2c-a83d-fc771e0de8b9"). InnerVolumeSpecName "kube-api-access-974sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:44.660140 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.660112    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-974sj\" (UniqueName: \"kubernetes.io/projected/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9-kube-api-access-974sj\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:44.777221 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.777187    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"]
Jul 16 18:24:44.777623 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.777609    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:44.777698 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.777628    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:44.777768 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.777729    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" containerName="test-curl-7596-140147846293808"
Jul 16 18:24:44.780950 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.780928    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:44.784031 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.784009    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:24:44.790401 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.790266    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"]
Jul 16 18:24:44.962835 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:44.962738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss\" (UID: \"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:45.064186 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.064148    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss\" (UID: \"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:45.064835 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.064816    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss\" (UID: \"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:45.094133 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.094101    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:45.234398 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.234370    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"]
Jul 16 18:24:45.234773 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:24:45.234751    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode94933d3_a7a9_4c5d_8489_ca65fbcd5f6d.slice/crio-e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b WatchSource:0}: Error finding container e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b: Status 404 returned error can't find the container with id e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b
Jul 16 18:24:45.330326 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.330280    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss" event={"ID":"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d","Type":"ContainerStarted","Data":"e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b"}
Jul 16 18:24:45.331521 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.331503    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:45.331627 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.331534    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76cd1804353a9757a08ee4a3ea16c81663ed21aa6a0ee19204f5beb489e7427e"
Jul 16 18:24:45.344878 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:24:45.344851    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7596-140147846293808\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:45.922472 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:24:45.922438    2577 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7596-140147846293808\" is forbidden: User \"system:node:ip-10-0-137-76.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-137-76.ec2.internal' and this object" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" pod="opendatahub/test-curl-7596-140147846293808"
Jul 16 18:24:45.923635 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:45.923614    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f3eec28-cb58-4b2c-a83d-fc771e0de8b9" path="/var/lib/kubelet/pods/7f3eec28-cb58-4b2c-a83d-fc771e0de8b9/volumes"
Jul 16 18:24:46.343542 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:46.343447    2577 generic.go:356] "Generic (PLEG): container finished" podID="e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d" containerID="73a8986bc1e4ce55d6ec43ba34e6fb42281ca42134df9c9d63a5bfc607631883" exitCode=0
Jul 16 18:24:46.343719 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:46.343542    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss" event={"ID":"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d","Type":"ContainerDied","Data":"73a8986bc1e4ce55d6ec43ba34e6fb42281ca42134df9c9d63a5bfc607631883"}
Jul 16 18:24:47.486769 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:47.486745    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:47.586397 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:47.586367    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca\") pod \"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d\" (UID: \"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d\") "
Jul 16 18:24:47.586719 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:47.586698    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d" (UID: "e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:24:47.687025 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:47.687000    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:48.356878 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:48.356847    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss"
Jul 16 18:24:48.357054 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:48.356891    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss" event={"ID":"e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d","Type":"ContainerDied","Data":"e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b"}
Jul 16 18:24:48.357054 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:48.356937    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e65c46cbf5bfdef98ca508a0fbae5f02cd2df2aacf45cf3e4432a6570922d86b"
Jul 16 18:24:54.834786 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:54.834756    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:24:54.835268 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:54.834995    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" podUID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" containerName="maas-api" containerID="cri-o://5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad" gracePeriod=30
Jul 16 18:24:54.871540 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:54.871516    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:24:55.088851 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.088788    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:24:55.141718 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.141682    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qgkk\" (UniqueName: \"kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk\") pod \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") "
Jul 16 18:24:55.141903 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.141728    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls\") pod \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") "
Jul 16 18:24:55.141903 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.141766    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca\") pod \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\" (UID: \"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a\") "
Jul 16 18:24:55.142219 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.142184    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" (UID: "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:24:55.143797 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.143767    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk" (OuterVolumeSpecName: "kube-api-access-8qgkk") pod "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" (UID: "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a"). InnerVolumeSpecName "kube-api-access-8qgkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:24:55.143797 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.143782    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" (UID: "fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:24:55.242667 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.242638    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qgkk\" (UniqueName: \"kubernetes.io/projected/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-kube-api-access-8qgkk\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:55.242667 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.242665    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:55.242667 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.242675    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:24:55.404147 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.404115    2577 generic.go:356] "Generic (PLEG): container finished" podID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" containerID="5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad" exitCode=0
Jul 16 18:24:55.404333 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.404179    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"
Jul 16 18:24:55.404333 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.404191    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" event={"ID":"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a","Type":"ContainerDied","Data":"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"}
Jul 16 18:24:55.404333 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.404245    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2" event={"ID":"fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a","Type":"ContainerDied","Data":"31e0bdc3ecadd36e70936874fed28673e9e373fbbb23bb2678a14d3b2cf1ea02"}
Jul 16 18:24:55.404333 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.404274    2577 scope.go:117] "RemoveContainer" containerID="5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"
Jul 16 18:24:55.414209 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.414190    2577 scope.go:117] "RemoveContainer" containerID="5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"
Jul 16 18:24:55.414577 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:24:55.414550    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad\": container with ID starting with 5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad not found: ID does not exist" containerID="5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"
Jul 16 18:24:55.414694 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.414587    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad"} err="failed to get container status \"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad\": rpc error: code = NotFound desc = could not find container \"5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad\": container with ID starting with 5d478ea77923fbed247514d4b001203d285a161df7cd6b12c70293e4b36545ad not found: ID does not exist"
Jul 16 18:24:55.436833 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.436802    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:24:55.452602 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.452577    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-a0389e-7bdc57fd64-5src2"]
Jul 16 18:24:55.923800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:24:55.923763    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" path="/var/lib/kubelet/pods/fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a/volumes"
Jul 16 18:25:00.005072 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:00.005045    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:00.432002 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:00.431965    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:06.834511 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:06.834443    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:07.356602 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.356570    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:07.421438 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.421409    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:07.504064 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504035    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"]
Jul 16 18:25:07.504475 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504463    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d" containerName="revoke-keys"
Jul 16 18:25:07.504530 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504477    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d" containerName="revoke-keys"
Jul 16 18:25:07.504530 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504495    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" containerName="maas-api"
Jul 16 18:25:07.504530 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504500    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" containerName="maas-api"
Jul 16 18:25:07.504625 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504577    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d" containerName="revoke-keys"
Jul 16 18:25:07.504625 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.504585    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa6b8bbf-f9ce-4e22-acbf-8dcba0c6602a" containerName="maas-api"
Jul 16 18:25:07.507474 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.507458    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:07.510212 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.510191    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-fgl7l\""
Jul 16 18:25:07.516154 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.516132    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"]
Jul 16 18:25:07.548852 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.548830    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv\" (UID: \"cc35bce7-2a6b-41fa-b083-db4e31250e71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:07.649246 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.649215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv\" (UID: \"cc35bce7-2a6b-41fa-b083-db4e31250e71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:07.649855 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.649836    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv\" (UID: \"cc35bce7-2a6b-41fa-b083-db4e31250e71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:07.819207 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.819175    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:07.964879 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:07.964850    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"]
Jul 16 18:25:07.965806 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:25:07.965782    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc35bce7_2a6b_41fa_b083_db4e31250e71.slice/crio-e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899 WatchSource:0}: Error finding container e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899: Status 404 returned error can't find the container with id e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899
Jul 16 18:25:08.482466 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:08.482426    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv" event={"ID":"cc35bce7-2a6b-41fa-b083-db4e31250e71","Type":"ContainerStarted","Data":"1a91d3de696f57d98817589f03f313308d525decffb08c741b5d979b89d899d0"}
Jul 16 18:25:08.482643 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:08.482480    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv" event={"ID":"cc35bce7-2a6b-41fa-b083-db4e31250e71","Type":"ContainerStarted","Data":"e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899"}
Jul 16 18:25:08.502335 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:08.502230    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv" podStartSLOduration=1.5022153980000001 podStartE2EDuration="1.502215398s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:25:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:25:08.499789423 +0000 UTC m=+3133.144012303" watchObservedRunningTime="2026-07-16 18:25:08.502215398 +0000 UTC m=+3133.146438276"
Jul 16 18:25:09.490159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:09.490121    2577 generic.go:356] "Generic (PLEG): container finished" podID="cc35bce7-2a6b-41fa-b083-db4e31250e71" containerID="1a91d3de696f57d98817589f03f313308d525decffb08c741b5d979b89d899d0" exitCode=0
Jul 16 18:25:09.492379 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:09.490211    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv" event={"ID":"cc35bce7-2a6b-41fa-b083-db4e31250e71","Type":"ContainerDied","Data":"1a91d3de696f57d98817589f03f313308d525decffb08c741b5d979b89d899d0"}
Jul 16 18:25:10.635253 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:10.635228    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:10.676222 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:10.676200    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca\") pod \"cc35bce7-2a6b-41fa-b083-db4e31250e71\" (UID: \"cc35bce7-2a6b-41fa-b083-db4e31250e71\") "
Jul 16 18:25:10.676617 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:10.676592    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cc35bce7-2a6b-41fa-b083-db4e31250e71" (UID: "cc35bce7-2a6b-41fa-b083-db4e31250e71"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:25:10.777726 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:10.777625    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cc35bce7-2a6b-41fa-b083-db4e31250e71-maas-api-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:25:11.502980 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:11.502955    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv"
Jul 16 18:25:11.503204 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:11.502951    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv" event={"ID":"cc35bce7-2a6b-41fa-b083-db4e31250e71","Type":"ContainerDied","Data":"e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899"}
Jul 16 18:25:11.503204 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:11.503079    2577 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e514f3cb72a668e095984e2409dd8b6c9af4c7d4b81471598c3fd6b2bec1c899"
Jul 16 18:25:17.557203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.557109    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:25:17.557680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.557382    2577 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" podUID="18c4601a-ad47-4655-8762-6af6b828120a" containerName="maas-api" containerID="cri-o://04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135" gracePeriod=30
Jul 16 18:25:17.582447 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.582410    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:17.806214 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.806193    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:25:17.843366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.843302    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") pod \"18c4601a-ad47-4655-8762-6af6b828120a\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") "
Jul 16 18:25:17.843366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.843346    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca\") pod \"18c4601a-ad47-4655-8762-6af6b828120a\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") "
Jul 16 18:25:17.843583 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.843379    2577 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xzqj\" (UniqueName: \"kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj\") pod \"18c4601a-ad47-4655-8762-6af6b828120a\" (UID: \"18c4601a-ad47-4655-8762-6af6b828120a\") "
Jul 16 18:25:17.843790 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.843760    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "18c4601a-ad47-4655-8762-6af6b828120a" (UID: "18c4601a-ad47-4655-8762-6af6b828120a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 16 18:25:17.845368 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.845341    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj" (OuterVolumeSpecName: "kube-api-access-5xzqj") pod "18c4601a-ad47-4655-8762-6af6b828120a" (UID: "18c4601a-ad47-4655-8762-6af6b828120a"). InnerVolumeSpecName "kube-api-access-5xzqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 16 18:25:17.845469 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.845439    2577 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "18c4601a-ad47-4655-8762-6af6b828120a" (UID: "18c4601a-ad47-4655-8762-6af6b828120a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 16 18:25:17.944037 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.944010    2577 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/18c4601a-ad47-4655-8762-6af6b828120a-maas-api-tls\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:25:17.944037 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.944033    2577 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/18c4601a-ad47-4655-8762-6af6b828120a-openshift-service-ca\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:25:17.944205 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:17.944043    2577 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xzqj\" (UniqueName: \"kubernetes.io/projected/18c4601a-ad47-4655-8762-6af6b828120a-kube-api-access-5xzqj\") on node \"ip-10-0-137-76.ec2.internal\" DevicePath \"\""
Jul 16 18:25:18.550331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.549668    2577 generic.go:356] "Generic (PLEG): container finished" podID="18c4601a-ad47-4655-8762-6af6b828120a" containerID="04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135" exitCode=0
Jul 16 18:25:18.550331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.549821    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" event={"ID":"18c4601a-ad47-4655-8762-6af6b828120a","Type":"ContainerDied","Data":"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"}
Jul 16 18:25:18.550331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.549900    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9" event={"ID":"18c4601a-ad47-4655-8762-6af6b828120a","Type":"ContainerDied","Data":"7e7747633b25a18d0b6a2ab054d3f4e367738c2f6dd509b98ba66cb10b2c2289"}
Jul 16 18:25:18.550331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.549929    2577 scope.go:117] "RemoveContainer" containerID="04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"
Jul 16 18:25:18.550331 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.550103    2577 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"
Jul 16 18:25:18.561572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.561357    2577 scope.go:117] "RemoveContainer" containerID="04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"
Jul 16 18:25:18.561806 ip-10-0-137-76 kubenswrapper[2577]: E0716 18:25:18.561584    2577 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135\": container with ID starting with 04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135 not found: ID does not exist" containerID="04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"
Jul 16 18:25:18.561806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.561608    2577 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135"} err="failed to get container status \"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135\": rpc error: code = NotFound desc = could not find container \"04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135\": container with ID starting with 04e4b98be06b66dfd071d548dcfb8cbb64ea8e05cea8e7128cff465496cca135 not found: ID does not exist"
Jul 16 18:25:18.574226 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.574201    2577 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:25:18.577015 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:18.576990    2577 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-bc54de-69dfd5c866-jqcq9"]
Jul 16 18:25:19.923053 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:19.923015    2577 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="18c4601a-ad47-4655-8762-6af6b828120a" path="/var/lib/kubelet/pods/18c4601a-ad47-4655-8762-6af6b828120a/volumes"
Jul 16 18:25:22.712979 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:22.712938    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:23.185330 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:23.185303    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:29.890135 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:29.890097    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:29.991356 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:29.991324    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:30.187150 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:30.187054    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:30.447447 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:30.447371    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:30.874816 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:30.874778    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79fcd99746-dp87t_682c6293-12a2-4ea5-8638-c9d7aef0c6e2/authorino/0.log"
Jul 16 18:25:36.781106 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:36.781076    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7r8c_0e4f34dd-7520-4cb8-813c-f8c7f4139170/manager/0.log"
Jul 16 18:25:36.908986 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:36.908956    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kk9hf_7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6/manager/0.log"
Jul 16 18:25:37.034353 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:37.034275    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d4d6b9447-k75hb_8ed941b1-6377-429c-953e-b2d83a9b4387/manager/0.log"
Jul 16 18:25:37.154865 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:37.154835    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tvrrq_70e44210-8c65-4186-bbf7-f29c151b1d0f/server/0.log"
Jul 16 18:25:37.287597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:37.287526    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mm9zq_fe6ee77c-6c28-4102-a478-992a05c04b29/manager/0.log"
Jul 16 18:25:37.755054 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:37.755027    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-p4gvk_29347a2e-12b1-49b6-8900-0c54eb05c2ed/copy-manifests/0.log"
Jul 16 18:25:37.771395 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:37.771364    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-p4gvk_29347a2e-12b1-49b6-8900-0c54eb05c2ed/manager/0.log"
Jul 16 18:25:38.149173 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.149145    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-66798f8484-ctvtk_e57f6f32-76f8-48fa-bf02-ea10121efbc2/maas-api/0.log"
Jul 16 18:25:38.271623 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.271594    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737080-tlhxm_2f17aa82-2563-40f1-80ed-b2a085a71e97/cleanup/0.log"
Jul 16 18:25:38.389914 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.389888    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29737095-c4nh5_30b449d9-9fc0-4fce-9d6c-8a32ca10e3a3/cleanup/0.log"
Jul 16 18:25:38.510962 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.510884    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-57c731f2-drbfk_188d81f1-9fb5-4f73-bd57-c8b18b98b61f/revoke-keys/0.log"
Jul 16 18:25:38.628129 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.628099    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-f06db564-ctfbz_010eb519-f527-40c5-a0ec-54aa87889b7d/revoke-keys/0.log"
Jul 16 18:25:38.745279 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.745254    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-e55530-x98sg_4a37336b-f80d-4b36-acb8-c6aca38f7271/revoke-keys/0.log"
Jul 16 18:25:38.868353 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.868328    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-502744-4zpg4_ab982314-82e3-45d0-9821-dce24ac03802/revoke-keys/0.log"
Jul 16 18:25:38.988159 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:38.988134    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-7be4c90b-mbk65_8998fb80-278f-4bcb-b2cc-5d1e86c40beb/revoke-keys/0.log"
Jul 16 18:25:39.109487 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.109463    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-a1a1f5-stldd_ac28efb8-982f-4d8f-bf2e-5b5fe96e4ed9/revoke-keys/0.log"
Jul 16 18:25:39.234180 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.234105    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-28bbcf-6qdm4_46dee15e-369b-4437-9351-d0336254d8e9/revoke-keys/0.log"
Jul 16 18:25:39.354024 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.353995    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-89f0be1f-d8skx_14942ac9-bdf7-4eb7-ad72-d03ba1c79c23/revoke-keys/0.log"
Jul 16 18:25:39.475755 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.475733    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-7a2e4989-bq76f_c3175ffb-c8cd-4222-b89f-32c6c12474dc/revoke-keys/0.log"
Jul 16 18:25:39.596263 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.596180    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-9826013b-qsc9k_71fee64e-b66e-4c12-9cee-e287801e089e/revoke-keys/0.log"
Jul 16 18:25:39.714936 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.714899    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-a0389e-nw7ss_e94933d3-a7a9-4c5d-8489-ca65fbcd5f6d/revoke-keys/0.log"
Jul 16 18:25:39.838037 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.838005    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-bc54de-flvqv_cc35bce7-2a6b-41fa-b083-db4e31250e71/revoke-keys/0.log"
Jul 16 18:25:39.958403 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:39.958377    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qh9mv_9b41703a-d8a4-414c-ae6e-d831ee334320/postgres/0.log"
Jul 16 18:25:40.833028 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.832999    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/util/0.log"
Jul 16 18:25:40.844628 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.844599    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/pull/0.log"
Jul 16 18:25:40.866806 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.866782    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/extract/0.log"
Jul 16 18:25:40.910636 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.910612    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:40.989363 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.989335    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/util/0.log"
Jul 16 18:25:40.996328 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:40.996309    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/pull/0.log"
Jul 16 18:25:41.003007 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.002969    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/extract/0.log"
Jul 16 18:25:41.008337 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.008316    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:41.126746 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.126715    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/util/0.log"
Jul 16 18:25:41.134346 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.134322    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/pull/0.log"
Jul 16 18:25:41.150514 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.150482    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/extract/0.log"
Jul 16 18:25:41.279616 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.279591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/pull/0.log"
Jul 16 18:25:41.286672 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.286650    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/extract/0.log"
Jul 16 18:25:41.293673 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.293648    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/util/0.log"
Jul 16 18:25:41.419632 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.419548    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79fcd99746-dp87t_682c6293-12a2-4ea5-8638-c9d7aef0c6e2/authorino/0.log"
Jul 16 18:25:41.546423 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.546394    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2ngr8_d2552b95-731a-4c83-b2fc-b51faed2e237/manager/0.log"
Jul 16 18:25:41.670567 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.670494    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zmg4h_ddc40b80-61db-45ae-89fe-107e59e01993/manager/0.log"
Jul 16 18:25:41.791558 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.791530    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-262zh_1756b7b7-96d1-4789-b42e-5e270b1855ba/kuadrant-console-plugin/0.log"
Jul 16 18:25:41.920498 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:41.920473    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6t2n2_aa38f825-2638-4593-8ca3-ca3d02700a42/registry-server/0.log"
Jul 16 18:25:42.048059 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:42.047991    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twmc6_12793fc6-7437-46f3-a2ab-9d6ddace3626/manager/0.log"
Jul 16 18:25:42.297203 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:42.297175    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4d9pj_bad879c2-faaf-4c33-92e6-b44b5b407d6d/manager/0.log"
Jul 16 18:25:42.932344 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:42.932314    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5966557cf8-wwkh8_0e985eb5-146c-4b58-aa8f-712d8c650e44/kube-auth-proxy/0.log"
Jul 16 18:25:43.337098 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:43.337026    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jrnrx_65020f35-c754-47b6-9785-f1e3bd26426c/payload-pre-processing/0.log"
Jul 16 18:25:43.467364 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:43.467337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2pzp_2e3051be-2d5d-4f26-bcb0-c96158a06303/payload-processing/0.log"
Jul 16 18:25:46.206012 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:46.205982    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:50.965136 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.965106    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:50.965643 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.965622    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6ppj/must-gather-vg9fg"]
Jul 16 18:25:50.966008 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.965997    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="18c4601a-ad47-4655-8762-6af6b828120a" containerName="maas-api"
Jul 16 18:25:50.966048 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.966009    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="18c4601a-ad47-4655-8762-6af6b828120a" containerName="maas-api"
Jul 16 18:25:50.966048 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.966026    2577 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc35bce7-2a6b-41fa-b083-db4e31250e71" containerName="revoke-keys"
Jul 16 18:25:50.966048 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.966032    2577 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc35bce7-2a6b-41fa-b083-db4e31250e71" containerName="revoke-keys"
Jul 16 18:25:50.966152 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.966091    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="18c4601a-ad47-4655-8762-6af6b828120a" containerName="maas-api"
Jul 16 18:25:50.966152 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.966107    2577 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc35bce7-2a6b-41fa-b083-db4e31250e71" containerName="revoke-keys"
Jul 16 18:25:50.969675 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.969654    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:50.975579 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.975555    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6ppj\"/\"openshift-service-ca.crt\""
Jul 16 18:25:50.976759 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.976737    2577 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p6ppj\"/\"default-dockercfg-46jhl\""
Jul 16 18:25:50.976837 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.976755    2577 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p6ppj\"/\"kube-root-ca.crt\""
Jul 16 18:25:50.991729 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:50.991703    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/must-gather-vg9fg"]
Jul 16 18:25:51.034906 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.034877    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffa08ad3-b176-4613-9505-b88aef6c4940-must-gather-output\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.035042 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.034919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbz9r\" (UniqueName: \"kubernetes.io/projected/ffa08ad3-b176-4613-9505-b88aef6c4940-kube-api-access-jbz9r\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.065746 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.065708    2577 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log" limit=1024
Jul 16 18:25:51.135572 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.135541    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffa08ad3-b176-4613-9505-b88aef6c4940-must-gather-output\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.135723 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.135575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbz9r\" (UniqueName: \"kubernetes.io/projected/ffa08ad3-b176-4613-9505-b88aef6c4940-kube-api-access-jbz9r\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.135891 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.135872    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/ffa08ad3-b176-4613-9505-b88aef6c4940-must-gather-output\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.148181 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.148153    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbz9r\" (UniqueName: \"kubernetes.io/projected/ffa08ad3-b176-4613-9505-b88aef6c4940-kube-api-access-jbz9r\") pod \"must-gather-vg9fg\" (UID: \"ffa08ad3-b176-4613-9505-b88aef6c4940\") " pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.279597 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.279524    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/must-gather-vg9fg"
Jul 16 18:25:51.418669 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.418641    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/must-gather-vg9fg"]
Jul 16 18:25:51.420260 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:25:51.420235    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podffa08ad3_b176_4613_9505_b88aef6c4940.slice/crio-a09c9d0ea4dde136dde5962d6653d7cc3f1605928af95c41e9263f4fd2557b52 WatchSource:0}: Error finding container a09c9d0ea4dde136dde5962d6653d7cc3f1605928af95c41e9263f4fd2557b52: Status 404 returned error can't find the container with id a09c9d0ea4dde136dde5962d6653d7cc3f1605928af95c41e9263f4fd2557b52
Jul 16 18:25:51.753349 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:51.753316    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/must-gather-vg9fg" event={"ID":"ffa08ad3-b176-4613-9505-b88aef6c4940","Type":"ContainerStarted","Data":"a09c9d0ea4dde136dde5962d6653d7cc3f1605928af95c41e9263f4fd2557b52"}
Jul 16 18:25:52.765499 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:52.765413    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/must-gather-vg9fg" event={"ID":"ffa08ad3-b176-4613-9505-b88aef6c4940","Type":"ContainerStarted","Data":"76558065e0f317d7aaf097032b3943129e5bf6a861899e53847e0187ab239ca3"}
Jul 16 18:25:52.765499 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:52.765465    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/must-gather-vg9fg" event={"ID":"ffa08ad3-b176-4613-9505-b88aef6c4940","Type":"ContainerStarted","Data":"db47ec1aba12d729143537840b640cfedba5adfaec6a6180acdd45d02216098d"}
Jul 16 18:25:52.794562 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:52.794506    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6ppj/must-gather-vg9fg" podStartSLOduration=1.800163388 podStartE2EDuration="2.794487472s" totalImagesPullingTime="994.324084ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 18:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:25:52.793007379 +0000 UTC m=+3177.437230258" watchObservedRunningTime="2026-07-16 18:25:52.794487472 +0000 UTC m=+3177.438710385"
Jul 16 18:25:54.452031 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:54.452003    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q7pt8_527be017-dd6d-4ba2-9799-353afac35e75/global-pull-secret-syncer/0.log"
Jul 16 18:25:54.599546 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:54.599516    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gdnxt_9b442b11-cb9c-4bac-87fa-8a7b1411f2bf/konnectivity-agent/0.log"
Jul 16 18:25:54.839165 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:54.839087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-76.ec2.internal_a740f5ec7352c6c6e3423deebd004375/haproxy/0.log"
Jul 16 18:25:58.831077 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:58.831051    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/extract/0.log"
Jul 16 18:25:58.881748 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:58.881723    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/util/0.log"
Jul 16 18:25:58.924431 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:58.924398    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759n4zg4_54dd67ad-ec37-4e93-bdb9-f4bcc19dc2a5/pull/0.log"
Jul 16 18:25:58.973961 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:58.973914    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/extract/0.log"
Jul 16 18:25:59.009119 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.009087    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/util/0.log"
Jul 16 18:25:59.050538 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.050438    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0szd74_da511b5e-1f60-4f73-b41f-814ea6d94ed8/pull/0.log"
Jul 16 18:25:59.092831 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.092756    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/extract/0.log"
Jul 16 18:25:59.126210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.126177    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/util/0.log"
Jul 16 18:25:59.162366 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.162337    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fsh66_0936526b-4e88-465b-b125-88016f58d87c/pull/0.log"
Jul 16 18:25:59.203669 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.203638    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/extract/0.log"
Jul 16 18:25:59.249376 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.249349    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/util/0.log"
Jul 16 18:25:59.305730 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.305701    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1g7qv7_12efee3d-269a-427f-b12b-7268659078bb/pull/0.log"
Jul 16 18:25:59.817918 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.817877    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-79fcd99746-dp87t_682c6293-12a2-4ea5-8638-c9d7aef0c6e2/authorino/0.log"
Jul 16 18:25:59.873210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.873174    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2ngr8_d2552b95-731a-4c83-b2fc-b51faed2e237/manager/0.log"
Jul 16 18:25:59.914865 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.914831    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-zmg4h_ddc40b80-61db-45ae-89fe-107e59e01993/manager/0.log"
Jul 16 18:25:59.972501 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:25:59.972463    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-262zh_1756b7b7-96d1-4789-b42e-5e270b1855ba/kuadrant-console-plugin/0.log"
Jul 16 18:26:00.048425 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:00.048380    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-6t2n2_aa38f825-2638-4593-8ca3-ca3d02700a42/registry-server/0.log"
Jul 16 18:26:00.245316 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:00.245235    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twmc6_12793fc6-7437-46f3-a2ab-9d6ddace3626/manager/0.log"
Jul 16 18:26:00.384533 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:00.384493    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4d9pj_bad879c2-faaf-4c33-92e6-b44b5b407d6d/manager/0.log"
Jul 16 18:26:02.417726 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:02.417694    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-ddcpz_1891b8fb-ab6f-4b42-a5dc-5ff2a1e712b6/cluster-monitoring-operator/0.log"
Jul 16 18:26:02.577934 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:02.577903    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-d7qb5_8e56e440-36d4-4504-8b6b-23fd24e438fe/monitoring-plugin/0.log"
Jul 16 18:26:02.613429 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:02.613395    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zm9c_bc724528-82ad-444c-9392-1e0ac69ef895/node-exporter/0.log"
Jul 16 18:26:02.641447 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:02.641414    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zm9c_bc724528-82ad-444c-9392-1e0ac69ef895/kube-rbac-proxy/0.log"
Jul 16 18:26:02.669936 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:02.669858    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5zm9c_bc724528-82ad-444c-9392-1e0ac69ef895/init-textfile/0.log"
Jul 16 18:26:04.850752 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:04.850726    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-c6n29_1b67646c-43f6-4729-a9dd-b0aa6bdda47c/networking-console-plugin/0.log"
Jul 16 18:26:04.943011 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:04.942981    2577 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"]
Jul 16 18:26:04.951169 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:04.951137    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:04.962073 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:04.962036    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"]
Jul 16 18:26:05.008528 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.008493    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-podres\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.008770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.008539    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-sys\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.008770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.008593    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvn68\" (UniqueName: \"kubernetes.io/projected/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-kube-api-access-tvn68\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.008770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.008697    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-proc\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.008770 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.008738    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-lib-modules\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.109708 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.109615    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-podres\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.109969 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.109945    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-sys\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110163 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110140    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvn68\" (UniqueName: \"kubernetes.io/projected/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-kube-api-access-tvn68\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110360 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110342    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-proc\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110509 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110492    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-lib-modules\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110609    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-lib-modules\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110502    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-proc\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.109863    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-podres\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.110680 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.110139    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-sys\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.121814 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.121252    2577 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvn68\" (UniqueName: \"kubernetes.io/projected/cc04fe9f-c51e-4ef1-83fe-ee016e787dfc-kube-api-access-tvn68\") pod \"perf-node-gather-daemonset-pmvbp\" (UID: \"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc\") " pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.269779 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.269532    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.447133 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.447100    2577 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"]
Jul 16 18:26:05.447705 ip-10-0-137-76 kubenswrapper[2577]: W0716 18:26:05.447678    2577 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcc04fe9f_c51e_4ef1_83fe_ee016e787dfc.slice/crio-6e6ebdad0caa80ce2872d7850cc77e49a139ef64ddd2ce658be919615caac50b WatchSource:0}: Error finding container 6e6ebdad0caa80ce2872d7850cc77e49a139ef64ddd2ce658be919615caac50b: Status 404 returned error can't find the container with id 6e6ebdad0caa80ce2872d7850cc77e49a139ef64ddd2ce658be919615caac50b
Jul 16 18:26:05.483928 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.483900    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/1.log"
Jul 16 18:26:05.490813 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.490787    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-4hw7p_7a577200-d34d-4a27-8e79-a4061138271e/console-operator/2.log"
Jul 16 18:26:05.895763 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.895730    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp" event={"ID":"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc","Type":"ContainerStarted","Data":"dd1a1657af41b15256dd20b96b4204233370e1ec13a1525543b24b92b77c38cc"}
Jul 16 18:26:05.896210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.895809    2577 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp" event={"ID":"cc04fe9f-c51e-4ef1-83fe-ee016e787dfc","Type":"ContainerStarted","Data":"6e6ebdad0caa80ce2872d7850cc77e49a139ef64ddd2ce658be919615caac50b"}
Jul 16 18:26:05.896210 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.895857    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:05.930655 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:05.930600    2577 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp" podStartSLOduration=1.930577191 podStartE2EDuration="1.930577191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 18:26:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 18:26:05.926641125 +0000 UTC m=+3190.570864040" watchObservedRunningTime="2026-07-16 18:26:05.930577191 +0000 UTC m=+3190.574800071"
Jul 16 18:26:08.113800 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:08.113773    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6nfk_8c618dbe-3d0a-4612-8731-8c851661de7a/dns/0.log"
Jul 16 18:26:08.148444 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:08.148414    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-r6nfk_8c618dbe-3d0a-4612-8731-8c851661de7a/kube-rbac-proxy/0.log"
Jul 16 18:26:08.326693 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:08.326664    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rgxwx_8d11b391-c98d-4cbb-a53a-d32cd4dc8c92/dns-node-resolver/0.log"
Jul 16 18:26:08.936131 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:08.936083    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b9588ddf6-m8zqw_54c0f925-b763-4fa7-8b82-a721d4d55d8f/registry/0.log"
Jul 16 18:26:08.961563 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:08.961536    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-k6vc5_13062e48-bf9d-49e5-880b-af8dd4584637/node-ca/0.log"
Jul 16 18:26:10.223689 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:10.223660    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5966557cf8-wwkh8_0e985eb5-146c-4b58-aa8f-712d8c650e44/kube-auth-proxy/0.log"
Jul 16 18:26:10.356335 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:10.356305    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jrnrx_65020f35-c754-47b6-9785-f1e3bd26426c/payload-pre-processing/0.log"
Jul 16 18:26:10.392747 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:10.392720    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2pzp_2e3051be-2d5d-4f26-bcb0-c96158a06303/payload-processing/0.log"
Jul 16 18:26:11.192869 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.192839    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dpphb_faad28a0-472d-4679-bab9-efe43ed45208/serve-healthcheck-canary/0.log"
Jul 16 18:26:11.760940 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.760913    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rwj5c_852c877c-5597-4f51-9540-13ea2ea6f28c/insights-operator/0.log"
Jul 16 18:26:11.761864 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.761815    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-rwj5c_852c877c-5597-4f51-9540-13ea2ea6f28c/insights-operator/1.log"
Jul 16 18:26:11.793122 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.793097    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hc7d_e843a222-8ac1-471a-99a1-a690742e8b6b/kube-rbac-proxy/0.log"
Jul 16 18:26:11.826809 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.826783    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hc7d_e843a222-8ac1-471a-99a1-a690742e8b6b/exporter/0.log"
Jul 16 18:26:11.861437 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.861409    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6hc7d_e843a222-8ac1-471a-99a1-a690742e8b6b/extractor/0.log"
Jul 16 18:26:11.915925 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:11.915897    2577 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p6ppj/perf-node-gather-daemonset-pmvbp"
Jul 16 18:26:14.326250 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:14.326222    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5966557cf8-wwkh8_0e985eb5-146c-4b58-aa8f-712d8c650e44/kube-auth-proxy/0.log"
Jul 16 18:26:14.457476 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:14.457391    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jrnrx_65020f35-c754-47b6-9785-f1e3bd26426c/payload-pre-processing/0.log"
Jul 16 18:26:14.487302 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:14.487236    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2pzp_2e3051be-2d5d-4f26-bcb0-c96158a06303/payload-processing/0.log"
Jul 16 18:26:14.800409 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:14.800365    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-d7r8c_0e4f34dd-7520-4cb8-813c-f8c7f4139170/manager/0.log"
Jul 16 18:26:15.055389 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.055346    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-kk9hf_7d3d39d2-7be5-4f84-9d94-43b0c4c3efd6/manager/0.log"
Jul 16 18:26:15.204326 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.202889    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5d4d6b9447-k75hb_8ed941b1-6377-429c-953e-b2d83a9b4387/manager/0.log"
Jul 16 18:26:15.235467 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.235434    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-tvrrq_70e44210-8c65-4186-bbf7-f29c151b1d0f/server/0.log"
Jul 16 18:26:15.323891 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.323814    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mm9zq_fe6ee77c-6c28-4102-a478-992a05c04b29/manager/0.log"
Jul 16 18:26:15.643728 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.643476    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-p4gvk_29347a2e-12b1-49b6-8900-0c54eb05c2ed/manager/0.log"
Jul 16 18:26:15.670263 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.670242    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-674ff8dd58-p4gvk_29347a2e-12b1-49b6-8900-0c54eb05c2ed/copy-manifests/0.log"
Jul 16 18:26:15.949932 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:15.949852    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5966557cf8-wwkh8_0e985eb5-146c-4b58-aa8f-712d8c650e44/kube-auth-proxy/0.log"
Jul 16 18:26:16.050844 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:16.050804    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7677b774bb-jrnrx_65020f35-c754-47b6-9785-f1e3bd26426c/payload-pre-processing/0.log"
Jul 16 18:26:16.078393 ip-10-0-137-76 kubenswrapper[2577]: I0716 18:26:16.078354    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5bf47cd988-k2pzp_2e3051be-2d5d-4f26-bcb0-c96158a06303/payload-processing/0.log"