Aug 04 15:04:37.845572 ip-10-0-136-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 04 15:04:37.845582 ip-10-0-136-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 04 15:04:37.845589 ip-10-0-136-138 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 04 15:04:37.845807 ip-10-0-136-138 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 04 15:04:47.912702 ip-10-0-136-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 04 15:04:47.912720 ip-10-0-136-138 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot e00b47f9d3174fea901746377081deef --
Aug 04 15:06:47.057059 ip-10-0-136-138 systemd[1]: Starting Kubernetes Kubelet...
Aug 04 15:06:47.444285 ip-10-0-136-138 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:47.444285 ip-10-0-136-138 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 04 15:06:47.444285 ip-10-0-136-138 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:47.444285 ip-10-0-136-138 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 04 15:06:47.444285 ip-10-0-136-138 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 04 15:06:47.445353 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.445201    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452087    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452118    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452122    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452126    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452130    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452134    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452138    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452141    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452146    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.452133 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452150    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452153    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452157    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452160    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452163    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452167    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452171    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452175    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452178    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452181    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452184    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452187    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452190    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452192    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452195    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452198    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452203    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452209    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452212    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452217    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.452599 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452220    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452223    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452227    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452234    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452237    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452241    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452246    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452268    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452272    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452276    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452279    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452283    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452286    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452289    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452293    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452296    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452299    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452302    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452305    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.453117 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452308    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452311    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452314    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452318    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452321    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452324    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452327    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452329    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452332    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452335    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452338    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452340    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452343    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452346    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452352    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452356    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452359    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452362    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452380    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.453645 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452383    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452386    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452389    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452393    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452396    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452399    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452402    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452405    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452408    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452413    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452416    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452419    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452422    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452425    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452427    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452430    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452434    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452437    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452440    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452443    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.454174 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452446    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452449    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452452    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452455    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452458    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452461    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452464    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452467    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452470    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452474    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452476    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.454721 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.452479    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.455201 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455182    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.455201 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455200    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455204    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455208    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455212    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455216    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455219    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455222    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455225    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455228    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455232    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455235    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455237    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455240    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455243    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455246    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455249    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455252    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455257    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455261    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.455258 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455267    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455271    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455275    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455279    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455282    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455285    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455288    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455291    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455294    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455297    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455301    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455304    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455308    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455311    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455313    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455316    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455319    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455322    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455325    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455328    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.455797 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455330    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455334    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455337    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455339    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455342    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455345    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455348    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455350    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455353    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455356    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455359    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455362    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455379    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455383    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455387    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455390    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455393    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455396    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455400    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455403    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.456334 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455406    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455409    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455412    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455415    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455417    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455420    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455423    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455425    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455429    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455431    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455434    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455440    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455443    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455445    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455448    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455451    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455454    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455457    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455460    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455463    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.456945 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455465    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455468    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455471    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455479    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455483    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455486    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455489    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455493    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455496    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455501    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455505    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455508    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455512    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455515    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455518    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455521    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455524    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455527    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455530    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.455999    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.457479 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456005    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456008    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456011    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456014    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456020    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456024    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456028    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456031    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456034    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456037    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456040    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456042    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456045    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456048    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456051    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456055    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456058    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456062    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456065    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456069    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.458018 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456072    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456075    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456078    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456081    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456084    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456087    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456089    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456092    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456095    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456098    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456101    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456103    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456106    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456109    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456112    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456115    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456118    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456121    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456124    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456127    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.458629 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456130    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456133    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456135    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456138    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456142    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456144    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456147    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456150    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456160    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456164    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456167    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456170    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456173    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456177    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456180    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456182    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456185    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456188    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456191    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456193    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.459185 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456197    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456200    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456202    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456205    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456208    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456211    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456214    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456216    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456219    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456222    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456226    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456230    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456232    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456235    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456238    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456240    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456245    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456247    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456250    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.459740 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456253    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456255    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456258    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456262    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456265    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456270    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456274    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456277    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456280    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456284    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456287    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456290    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456293    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456297    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456300    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456303    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456305    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456308    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.456311    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456444    2571 flags.go:64] FLAG: --address="0.0.0.0"
Aug 04 15:06:47.460294 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456478    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456489    2571 flags.go:64] FLAG: --anonymous-auth="true"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456495    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456500    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456504    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456509    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456514    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456519    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456522    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456527    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456530    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456534    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456537    2571 flags.go:64] FLAG: --cgroup-root=""
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456541    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456544    2571 flags.go:64] FLAG: --client-ca-file=""
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456547    2571 flags.go:64] FLAG: --cloud-provider="external"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456551    2571 flags.go:64] FLAG: --cluster-dns="[]"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456556    2571 flags.go:64] FLAG: --cluster-domain=""
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456559    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456562    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456566    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456569    2571 flags.go:64] FLAG: --container-log-max-files="5"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456574    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 04 15:06:47.460854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456577    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456581    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456584    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456588    2571 flags.go:64] FLAG: --contention-profiling="false"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456591    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456595    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456598    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456602    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456607    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456613    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456617    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456621    2571 flags.go:64] FLAG: --enable-load-reader="false"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456624    2571 flags.go:64] FLAG: --enable-server="true"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456628    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456634    2571 flags.go:64] FLAG: --event-burst="100"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456638    2571 flags.go:64] FLAG: --event-qps="50"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456641    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456645    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456648    2571 flags.go:64] FLAG: --eviction-hard=""
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456653    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456656    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456659    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456663    2571 flags.go:64] FLAG: --eviction-soft=""
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456666    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456670    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 04 15:06:47.461517 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456673    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456676    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456680    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456683    2571 flags.go:64] FLAG: --fail-swap-on="true"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456686    2571 flags.go:64] FLAG: --feature-gates=""
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456691    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456694    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456697    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456701    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456704    2571 flags.go:64] FLAG: --healthz-port="10248"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456707    2571 flags.go:64] FLAG: --help="false"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456710    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456714    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456717    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456721    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456727    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456732    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456745    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456749    2571 flags.go:64] FLAG: --image-service-endpoint=""
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456752    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456756    2571 flags.go:64] FLAG: --kube-api-burst="100"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456759    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456763    2571 flags.go:64] FLAG: --kube-api-qps="50"
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456767    2571 flags.go:64] FLAG: --kube-reserved=""
Aug 04 15:06:47.462208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456770    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456774    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456777    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456781    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456784    2571 flags.go:64] FLAG: --lock-file=""
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456787    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456791    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456794    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456802    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456805    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456808    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456811    2571 flags.go:64] FLAG: --logging-format="text"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456814    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456818    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456822    2571 flags.go:64] FLAG: --manifest-url=""
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456828    2571 flags.go:64] FLAG: --manifest-url-header=""
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456834    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456838    2571 flags.go:64] FLAG: --max-open-files="1000000"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456842    2571 flags.go:64] FLAG: --max-pods="110"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456846    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456849    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456853    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456856    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456859    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456864    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 04 15:06:47.462894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456867    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456883    2571 flags.go:64] FLAG: --node-status-max-images="50"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456887    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456890    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456895    2571 flags.go:64] FLAG: --pod-cidr=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456899    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456905    2571 flags.go:64] FLAG: --pod-manifest-path=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456909    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456912    2571 flags.go:64] FLAG: --pods-per-core="0"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456915    2571 flags.go:64] FLAG: --port="10250"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456919    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456922    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06d303bb2bd9809eb"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456925    2571 flags.go:64] FLAG: --qos-reserved=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456929    2571 flags.go:64] FLAG: --read-only-port="10255"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456932    2571 flags.go:64] FLAG: --register-node="true"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456935    2571 flags.go:64] FLAG: --register-with-taints=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456939    2571 flags.go:64] FLAG: --registry-burst="10"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456942    2571 flags.go:64] FLAG: --registry-qps="5"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456945    2571 flags.go:64] FLAG: --reserved-cpus=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456949    2571 flags.go:64] FLAG: --reserved-memory=""
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456953    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456956    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456962    2571 flags.go:64] FLAG: --rotate-certificates="false"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456965    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456968    2571 flags.go:64] FLAG: --runonce="false"
Aug 04 15:06:47.463596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456972    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456975    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456979    2571 flags.go:64] FLAG: --seccomp-default="false"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456982    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456985    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456989    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456992    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.456998    2571 flags.go:64] FLAG: --storage-driver-password="root"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457002    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457006    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457009    2571 flags.go:64] FLAG: --storage-driver-user="root"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457013    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457016    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457020    2571 flags.go:64] FLAG: --system-cgroups=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457023    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457031    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457035    2571 flags.go:64] FLAG: --tls-cert-file=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457038    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457045    2571 flags.go:64] FLAG: --tls-min-version=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457048    2571 flags.go:64] FLAG: --tls-private-key-file=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457052    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457055    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457058    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457062    2571 flags.go:64] FLAG: --v="2"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457067    2571 flags.go:64] FLAG: --version="false"
Aug 04 15:06:47.464328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457071    2571 flags.go:64] FLAG: --vmodule=""
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457076    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457079    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457248    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457255    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457258    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457261    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457264    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457267    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457270    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457273    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457276    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457279    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457282    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457286    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457289    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457292    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457297    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457300    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457304    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.465024 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457307    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457310    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457313    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457316    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457320    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457324    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457329    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457333    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457336    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457339    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457342    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457346    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457349    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457352    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457355    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457358    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457363    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457379    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457382    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457386    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.465606 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457389    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457392    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457395    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457398    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457401    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457405    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457411    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457415    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457420    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457423    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457427    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457431    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457434    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457437    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457440    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457443    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457446    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457448    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457452    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457455    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.466150 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457458    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457461    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457464    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457467    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457470    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457472    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457475    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457478    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457483    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457486    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457489    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457492    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457496    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457499    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457502    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457505    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457508    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457511    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457516    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.466787 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457519    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457521    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457525    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457530    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457534    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457538    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457542    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457546    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457549    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457552    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457555    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457558    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457562    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457565    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457568    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457571    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457574    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457577    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457580    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.467315 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457583    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457585    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457590    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.457593    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.457599    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.465994    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.466022    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.466046    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.466056    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466144    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466150    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466155    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466159    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466163    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466166    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.467836 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466169    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466173    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466185    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466190    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466193    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466196    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466200    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466203    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466206    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466209    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466212    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466215    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466217    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466220    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466223    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466226    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466229    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466232    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466235    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466237    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.468245 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466240    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466243    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466248    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466253    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466259    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466262    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466266    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466269    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466272    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466275    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466278    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466281    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466284    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466287    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466290    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466299    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466302    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466306    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466309    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.468789 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466311    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466315    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466318    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466321    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466324    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466327    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466329    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466332    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466335    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466338    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466340    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466343    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466346    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466349    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466352    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466354    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466358    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466361    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466385    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.469305 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466389    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466392    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466395    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466398    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466401    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466404    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466407    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466410    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466413    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466425    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466437    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466441    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466444    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466446    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466449    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466452    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466455    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466457    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466460    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466463    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.469822 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466466    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466469    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466471    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466474    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466477    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466479    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466482    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466485    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466488    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466492    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466495    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466499    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466502    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466505    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466508    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.470351 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.466514    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466692    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466698    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466701    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466704    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466707    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466710    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466714    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466723    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466727    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466730    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466733    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466736    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466739    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466741    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466745    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466747    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466750    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466753    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466756    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 04 15:06:47.470858 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466759    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466762    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466764    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466767    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466770    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466773    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466776    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466780    2571 feature_gate.go:328] unrecognized feature gate: Example
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466783    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466786    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466789    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466792    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466795    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466798    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466801    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466805    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466808    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466811    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466814    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466816    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466819    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 04 15:06:47.471409 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466829    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466832    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466835    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466837    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466840    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466843    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466846    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466849    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466852    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466854    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466857    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466861    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466865    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466868    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466872    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466875    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466879    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466883    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 04 15:06:47.471984 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466887    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466891    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466894    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466898    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466901    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466904    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466907    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466910    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466913    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466916    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466919    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466922    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466924    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466927    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466930    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466940    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466943    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466946    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466948    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466951    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 04 15:06:47.472473 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466954    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466957    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466960    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466962    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466965    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466968    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466971    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466974    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466976    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466981    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466985    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466988    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466995    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.466998    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467001    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467004    2571 feature_gate.go:328] unrecognized feature gate: Example2
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467008    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467011    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467014    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 04 15:06:47.473014 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467017    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:47.467020    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.467025    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.467206    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.469608    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.471007    2571 server.go:1019] "Starting client certificate rotation"
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.471123    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 15:06:47.473540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.471174    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 04 15:06:47.473742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.473691    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 15:06:47.476948 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.476924    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 04 15:06:47.489176 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.489144    2571 log.go:25] "Validated CRI v1 runtime API"
Aug 04 15:06:47.492612 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.492588    2571 log.go:25] "Validated CRI v1 image API"
Aug 04 15:06:47.493695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.493675    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 04 15:06:47.496708 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.496685    2571 fs.go:135] Filesystem UUIDs: map[072d06b7-acc1-4f0a-a4ca-d7a752606d9f:/dev/nvme0n1p4 26360d56-793f-4170-afae-81586db8f026:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Aug 04 15:06:47.496781 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.496707    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 04 15:06:47.501785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.501655    2571 manager.go:216] Machine: {Timestamp:2026-08-04 15:06:47.501102448 +0000 UTC m=+0.333070559 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103415 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20cafdb23be899ed60f4072a1be063 SystemUUID:ec20cafd-b23b-e899-ed60-f4072a1be063 BootID:e00b47f9-d317-4fea-9017-46377081deef Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:80:c3:c5:03:99 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:80:c3:c5:03:99 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:21:4d:fc:f9:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 04 15:06:47.501785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.501775    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 04 15:06:47.501918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.501873    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 04 15:06:47.504905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.504862    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 04 15:06:47.505080 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.504908    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 04 15:06:47.506634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.506617    2571 topology_manager.go:138] "Creating topology manager with none policy"
Aug 04 15:06:47.506683 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.506638    2571 container_manager_linux.go:309] "Creating device plugin manager"
Aug 04 15:06:47.506683 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.506648    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 15:06:47.507356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.507343    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 04 15:06:47.508154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.508142    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 04 15:06:47.509989 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.509967    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 15:06:47.512272 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512254    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 15:06:47.512459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512446    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 04 15:06:47.512502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512486    2571 kubelet.go:486] "Attempting to sync node with API server"
Aug 04 15:06:47.512502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512499    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 04 15:06:47.512566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512514    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 04 15:06:47.512566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512527    2571 kubelet.go:398] "Adding apiserver pod source"
Aug 04 15:06:47.512566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512537    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 04 15:06:47.512991 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.512975    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 15:06:47.513081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.513003    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 04 15:06:47.515244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.515219    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 04 15:06:47.516752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.516734    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 04 15:06:47.516813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.516770    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 04 15:06:47.517817 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517803    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 04 15:06:47.517862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517824    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 04 15:06:47.517862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517832    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 04 15:06:47.517862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517841    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 04 15:06:47.517862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517857    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517866    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517877    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517883    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517891    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517897    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517907    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517913    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517942    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 04 15:06:47.517979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.517949    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 04 15:06:47.521736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.521716    2571 server.go:1268] "Started kubelet"
Aug 04 15:06:47.521972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.521910    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 04 15:06:47.522036 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.522007    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 04 15:06:47.522130 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.522100    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 04 15:06:47.522806 ip-10-0-136-138 systemd[1]: Started Kubernetes Kubelet.
Aug 04 15:06:47.524613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.524598    2571 server.go:310] "Adding debug handlers to kubelet server"
Aug 04 15:06:47.525292 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.525252    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 04 15:06:47.525522 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.525480    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 04 15:06:47.525581 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.525538    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 04 15:06:47.526157 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.526136    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 04 15:06:47.528777 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.528685    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 04 15:06:47.531338 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.530283    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-138.ec2.internal.18c8a293b453c0ce  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-138.ec2.internal,UID:ip-10-0-136-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-138.ec2.internal,},FirstTimestamp:2026-08-04 15:06:47.521681614 +0000 UTC m=+0.353649781,LastTimestamp:2026-08-04 15:06:47.521681614 +0000 UTC m=+0.353649781,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-138.ec2.internal,}"
Aug 04 15:06:47.533120 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.533081    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 04 15:06:47.533247 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.533224    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:47.533338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.533088    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 04 15:06:47.533732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.533714    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 04 15:06:47.534335 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.533850    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 04 15:06:47.534436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534425    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 04 15:06:47.534677 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534650    2571 reconstruct.go:97] "Volume reconstruction finished"
Aug 04 15:06:47.534677 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534665    2571 reconciler.go:29] "Reconciler: start to sync state"
Aug 04 15:06:47.534793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534730    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 04 15:06:47.534793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534749    2571 factory.go:55] Registering systemd factory
Aug 04 15:06:47.534793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.534761    2571 factory.go:223] Registration of the systemd container factory successfully
Aug 04 15:06:47.535086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.535069    2571 factory.go:153] Registering CRI-O factory
Aug 04 15:06:47.535162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.535091    2571 factory.go:223] Registration of the crio container factory successfully
Aug 04 15:06:47.535162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.535119    2571 factory.go:103] Registering Raw factory
Aug 04 15:06:47.535162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.535134    2571 manager.go:1196] Started watching for new ooms in manager
Aug 04 15:06:47.535704 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.535688    2571 manager.go:349] Starting recovery of all containers
Aug 04 15:06:47.540863 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.540828    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 04 15:06:47.541015 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.540890    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 04 15:06:47.548402 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.548381    2571 manager.go:354] Recovery completed
Aug 04 15:06:47.553206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.553185    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.555630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.555599    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.555783 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.555643    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.555783 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.555655    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.556292 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.556275    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 04 15:06:47.556292 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.556288    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 04 15:06:47.556428 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.556311    2571 state_mem.go:36] "Initialized new in-memory state store"
Aug 04 15:06:47.556428 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.556275    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557489    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557536    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557562    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557671    2571 policy_none.go:49] "None policy: Start"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557691    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 04 15:06:47.557933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.557706    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 04 15:06:47.558520 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.558411    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-138.ec2.internal.18c8a293b659b5f8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-138.ec2.internal,UID:ip-10-0-136-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-138.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-138.ec2.internal,},FirstTimestamp:2026-08-04 15:06:47.555626488 +0000 UTC m=+0.387594599,LastTimestamp:2026-08-04 15:06:47.555626488 +0000 UTC m=+0.387594599,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-138.ec2.internal,}"
Aug 04 15:06:47.559351 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.559334    2571 policy_none.go:47] "Start"
Aug 04 15:06:47.572587 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.572261    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-138.ec2.internal.18c8a293b65a0cf4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-138.ec2.internal,UID:ip-10-0-136-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-138.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-138.ec2.internal,},FirstTimestamp:2026-08-04 15:06:47.555648756 +0000 UTC m=+0.387616868,LastTimestamp:2026-08-04 15:06:47.555648756 +0000 UTC m=+0.387616868,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-138.ec2.internal,}"
Aug 04 15:06:47.575970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.575939    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9pft5"
Aug 04 15:06:47.592250 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592213    2571 manager.go:337] "Starting Device Plugin manager"
Aug 04 15:06:47.592451 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.592272    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 04 15:06:47.592451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592289    2571 server.go:87] "Starting device plugin registration server"
Aug 04 15:06:47.592692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592676    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 04 15:06:47.592781 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592695    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 04 15:06:47.592875 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592849    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 04 15:06:47.593008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592978    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 04 15:06:47.593008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.592993    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 04 15:06:47.593622 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.593597    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 04 15:06:47.593708 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.593657    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:47.593961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.593940    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9pft5"
Aug 04 15:06:47.598708 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.598627    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-138.ec2.internal.18c8a293b65a3878  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-138.ec2.internal,UID:ip-10-0-136-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-138.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-138.ec2.internal,},FirstTimestamp:2026-08-04 15:06:47.555659896 +0000 UTC m=+0.387628005,LastTimestamp:2026-08-04 15:06:47.555659896 +0000 UTC m=+0.387628005,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-138.ec2.internal,}"
Aug 04 15:06:47.692987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.692933    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.694270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.694039    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.694270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.694071    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.694270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.694088    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.694270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.694122    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.715782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.715737    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 04 15:06:47.717157 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.717122    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 04 15:06:47.717251 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.717178    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 04 15:06:47.717251 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.717211    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 04 15:06:47.717357 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.717290    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Aug 04 15:06:47.718761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.718733    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.718848 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.718768    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-138.ec2.internal\": node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:47.728267 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.728228    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:47.814213 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.814182    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:47.817427 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.817395    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"]
Aug 04 15:06:47.817493 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.817480    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.819126 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.819104    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.819223 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.819144    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.819223 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.819161    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.820692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.820677    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.820829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.820813    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.820870 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.820851    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.821667 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821647    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.821777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821687    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.821777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821703    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.821777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821647    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.821777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821762    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.821777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.821774    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.823361 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.823343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.823445 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.823401    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:47.824634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.824615    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:47.824715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.824654    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:47.824715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.824670    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:47.835581 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.835550    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.835581 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.835584    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73bf5884360a6f56fb29aa28fa2e9510-config\") pod \"kube-apiserver-proxy-ip-10-0-136-138.ec2.internal\" (UID: \"73bf5884360a6f56fb29aa28fa2e9510\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.835752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.835611    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.849512 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.849482    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-138.ec2.internal\" not found" node="ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.854382 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.854343    2571 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-138.ec2.internal\" not found" node="ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.914932 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:47.914894    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:47.936584 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936548    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.936713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.936713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73bf5884360a6f56fb29aa28fa2e9510-config\") pod \"kube-apiserver-proxy-ip-10-0-136-138.ec2.internal\" (UID: \"73bf5884360a6f56fb29aa28fa2e9510\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.936713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936671    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.936816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936743    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac49cd09f4ea040536649438f74c9097-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal\" (UID: \"ac49cd09f4ea040536649438f74c9097\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:47.936816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:47.936791    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/73bf5884360a6f56fb29aa28fa2e9510-config\") pod \"kube-apiserver-proxy-ip-10-0-136-138.ec2.internal\" (UID: \"73bf5884360a6f56fb29aa28fa2e9510\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:48.015087 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.014994    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.117513 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.117455    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.152577 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.152522    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:48.157521 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.157093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:48.218311 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.218265    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.319862 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.319756    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.425610 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.425568    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.470560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.470518    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 04 15:06:48.471050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.470722    2571 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 04 15:06:48.525929 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.525861    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.599545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.599436    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-03 15:01:48 +0000 UTC" deadline="2028-02-13 23:44:19.524445957 +0000 UTC"
Aug 04 15:06:48.599545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.599477    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13400h37m30.924972903s"
Aug 04 15:06:48.612609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.612569    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 04 15:06:48.614190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.614169    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientMemory"
Aug 04 15:06:48.614255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.614207    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasNoDiskPressure"
Aug 04 15:06:48.614255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.614221    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeHasSufficientPID"
Aug 04 15:06:48.627101 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:48.627068    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-138.ec2.internal\" not found"
Aug 04 15:06:48.715147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.715116    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:48.734129 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.734096    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:48.779107 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.779077    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 15:06:48.782499 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.782476    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal"
Aug 04 15:06:48.802579 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:48.802540    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73bf5884360a6f56fb29aa28fa2e9510.slice/crio-39c9af5adb3a1f506597cb000c61e4a57044d6d52b928334e7283c4d05146c23 WatchSource:0}: Error finding container 39c9af5adb3a1f506597cb000c61e4a57044d6d52b928334e7283c4d05146c23: Status 404 returned error can't find the container with id 39c9af5adb3a1f506597cb000c61e4a57044d6d52b928334e7283c4d05146c23
Aug 04 15:06:48.811954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.811932    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:06:48.836018 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:48.835988    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 04 15:06:48.930774 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:48.930737    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac49cd09f4ea040536649438f74c9097.slice/crio-14fc782dfbf731a64f1e7849a78f78b46c6dae92cfad8c505dff9f1dadf5ee7d WatchSource:0}: Error finding container 14fc782dfbf731a64f1e7849a78f78b46c6dae92cfad8c505dff9f1dadf5ee7d: Status 404 returned error can't find the container with id 14fc782dfbf731a64f1e7849a78f78b46c6dae92cfad8c505dff9f1dadf5ee7d
Aug 04 15:06:49.025818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.025778    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:49.106131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.106089    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:49.514243 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.514198    2571 apiserver.go:52] "Watching apiserver"
Aug 04 15:06:49.527213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.527171    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 04 15:06:49.527840 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.527802    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-6zkwp","openshift-network-operator/iptables-alerter-hglhm","kube-system/global-pull-secret-syncer-lchxp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj","openshift-cluster-node-tuning-operator/tuned-lsvkf","openshift-dns/node-resolver-mjsfq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-4b2l8","kube-system/konnectivity-agent-lqpsg","kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal","openshift-image-registry/node-ca-x5l8b","openshift-multus/multus-additional-cni-plugins-b6dqw","openshift-multus/multus-szxzj","openshift-multus/network-metrics-daemon-dsrmg"]
Aug 04 15:06:49.529727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.529694    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.531110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.531079    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.533486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.533457    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 04 15:06:49.533924 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.533900    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.534064 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.534026    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:49.534664 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.534640    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-krpq7\""
Aug 04 15:06:49.536257 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.536234    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.536519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.536501    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.537986 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.537962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.539425 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.539401    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.541515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.541484    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:49.541619 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.541573    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:06:49.542969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.542325    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.542969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.542655    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 04 15:06:49.542969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.542918    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.543145 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.543134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-86xsr\""
Aug 04 15:06:49.543628 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.543326    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.543628 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.543343    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.543628 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.543397    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m44fs\""
Aug 04 15:06:49.543843 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.543806    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.544760    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.544819    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.544825    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bm984\""
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.545110    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.545129    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.545147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.545144    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 04 15:06:49.545779 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.545757    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.545878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.545834    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q8hkz\""
Aug 04 15:06:49.547022 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.546995    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpcdf\" (UniqueName: \"kubernetes.io/projected/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-kube-api-access-kpcdf\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.547122 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drkcj\" (UniqueName: \"kubernetes.io/projected/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-kube-api-access-drkcj\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.547122 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16864864-2787-4792-9638-fea9159787ab-host-slash\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.547122 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bms\" (UniqueName: \"kubernetes.io/projected/16864864-2787-4792-9638-fea9159787ab-kube-api-access-49bms\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.547304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547139    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-socket-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg75p\" (UniqueName: \"kubernetes.io/projected/788e6699-966c-4f65-b98b-a80ccc31f276-kube-api-access-qg75p\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547233    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-host\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.547304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547252    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547318    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-registration-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-sys-fs\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547380    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-serviceca\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16864864-2787-4792-9638-fea9159787ab-iptables-alerter-script\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-device-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.547983 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.547965    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.549908 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.549884    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.551862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.551530    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.551862 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.551622    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:49.554099 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.554075    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.554219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.554097    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 04 15:06:49.554496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.554446    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.554752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.554730    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 04 15:06:49.559522 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.559492    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 04 15:06:49.559878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.559783    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.560378 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.560335    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8jdfj\""
Aug 04 15:06:49.560572 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.560549    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 04 15:06:49.560648 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.560627    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 04 15:06:49.560829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.560803    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 04 15:06:49.562563 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.562542    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.562660    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.562901    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pcw5k\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.563029    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.563045    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-95nvc\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.562901    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c2z6b\""
Aug 04 15:06:49.563460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.563216    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 04 15:06:49.563767 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.563748    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 04 15:06:49.563982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.563959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 04 15:06:49.565280 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.565257    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 04 15:06:49.576693 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.576605    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 04 15:06:49.635842 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.635803    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 04 15:06:49.648119 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648069    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-tmp\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.648373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-netns\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.648373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648215    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.648373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-k8s-cni-cncf-io\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.648373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648294    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-multus-certs\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.648373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-device-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-device-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648433    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-var-lib-kubelet\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hct\" (UniqueName: \"kubernetes.io/projected/4a285c7d-4b71-4bbb-b0a4-7d2699005285-kube-api-access-r5hct\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648499    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-hostroot\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drkcj\" (UniqueName: \"kubernetes.io/projected/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-kube-api-access-drkcj\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-netd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.648711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648684    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f3297b-9f00-4ffc-9cc6-697505b9613a-agent-certs\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-bin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648752    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-run\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648783    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16864864-2787-4792-9638-fea9159787ab-host-slash\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-tuned\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648892    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/16864864-2787-4792-9638-fea9159787ab-host-slash\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-bin\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648939    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-etc-kubernetes\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.648970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-host\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649001    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-os-release\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.649077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-host\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649102    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-systemd-units\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-systemd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649213    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649279    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649337    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-slash\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649370    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-var-lib-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649427    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-env-overrides\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649505    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-os-release\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-system-cni-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649560    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649582    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec2985c-9403-49fd-ba66-f5f36e348cf7-hosts-file\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649607    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bms\" (UniqueName: \"kubernetes.io/projected/16864864-2787-4792-9638-fea9159787ab-kube-api-access-49bms\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-socket-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-kubelet\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.649721 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-etc-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovn-node-metrics-cert\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzwdn\" (UniqueName: \"kubernetes.io/projected/102b40db-894d-4243-843c-5230824ce815-kube-api-access-wzwdn\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649827    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649876    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-conf\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649904    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-socket-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-serviceca\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.649966    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16864864-2787-4792-9638-fea9159787ab-iptables-alerter-script\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-sys\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.650039    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650155    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-host\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.650234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650182    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.650292    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:06:50.150246614 +0000 UTC m=+2.982214740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-netns\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpcdf\" (UniqueName: \"kubernetes.io/projected/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-kube-api-access-kpcdf\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pt9\" (UniqueName: \"kubernetes.io/projected/aac66822-d301-461f-a00c-075b19c6e3f5-kube-api-access-k6pt9\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-ovn\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650563    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-kubelet\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-serviceca\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg75p\" (UniqueName: \"kubernetes.io/projected/788e6699-966c-4f65-b98b-a80ccc31f276-kube-api-access-qg75p\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-conf-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650727    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/16864864-2787-4792-9638-fea9159787ab-iptables-alerter-script\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-registration-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-sys-fs\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650791    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-registration-dir\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.650829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-sys-fs\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-script-lib\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rxzc\" (UniqueName: \"kubernetes.io/projected/bcd67637-5c2b-4ae5-8753-2460a97e650b-kube-api-access-4rxzc\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650890    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-cni-binary-copy\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650909    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-multus\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-cnibin\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650942    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.650973    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-system-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-socket-dir-parent\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-multus-daemon-config\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651088    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-node-log\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651114    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-log-socket\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651138    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec2985c-9403-49fd-ba66-f5f36e348cf7-tmp-dir\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651166    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk86r\" (UniqueName: \"kubernetes.io/projected/cec2985c-9403-49fd-ba66-f5f36e348cf7-kube-api-access-vk86r\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-cnibin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-lib-modules\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.651671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651250    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-modprobe-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651350    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysconfig\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651371    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651392    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-kubelet-config\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-dbus\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651430    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/788e6699-966c-4f65-b98b-a80ccc31f276-etc-selinux\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651445    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f3297b-9f00-4ffc-9cc6-697505b9613a-konnectivity-ca\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651481    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-config\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-kubernetes\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.652508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.651520    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-systemd\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.653083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.652744    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-9xv6j"
Aug 04 15:06:49.674910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.674365    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-9xv6j"
Aug 04 15:06:49.677873 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.677837    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 04 15:06:49.682765 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.682733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drkcj\" (UniqueName: \"kubernetes.io/projected/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-kube-api-access-drkcj\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:49.682927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.682819    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg75p\" (UniqueName: \"kubernetes.io/projected/788e6699-966c-4f65-b98b-a80ccc31f276-kube-api-access-qg75p\") pod \"aws-ebs-csi-driver-node-m4srj\" (UID: \"788e6699-966c-4f65-b98b-a80ccc31f276\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.684764 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.684732    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpcdf\" (UniqueName: \"kubernetes.io/projected/25f6e80e-d6ec-49df-a7fa-d9d5e638d09e-kube-api-access-kpcdf\") pod \"node-ca-x5l8b\" (UID: \"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e\") " pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.684764 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.684754    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bms\" (UniqueName: \"kubernetes.io/projected/16864864-2787-4792-9638-fea9159787ab-kube-api-access-49bms\") pod \"iptables-alerter-hglhm\" (UID: \"16864864-2787-4792-9638-fea9159787ab\") " pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.689568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.689537    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 04 15:06:49.723256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.723191    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal" event={"ID":"73bf5884360a6f56fb29aa28fa2e9510","Type":"ContainerStarted","Data":"39c9af5adb3a1f506597cb000c61e4a57044d6d52b928334e7283c4d05146c23"}
Aug 04 15:06:49.724963 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.724921    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal" event={"ID":"ac49cd09f4ea040536649438f74c9097","Type":"ContainerStarted","Data":"14fc782dfbf731a64f1e7849a78f78b46c6dae92cfad8c505dff9f1dadf5ee7d"}
Aug 04 15:06:49.752606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752566    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752618    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-system-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-socket-dir-parent\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-multus-daemon-config\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-node-log\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752778    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-log-socket\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.752814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752810    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec2985c-9403-49fd-ba66-f5f36e348cf7-tmp-dir\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk86r\" (UniqueName: \"kubernetes.io/projected/cec2985c-9403-49fd-ba66-f5f36e348cf7-kube-api-access-vk86r\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752887    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-cnibin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-lib-modules\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-modprobe-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysconfig\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.752986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753005    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-kubelet-config\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753030    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-dbus\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f3297b-9f00-4ffc-9cc6-697505b9613a-konnectivity-ca\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753088    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-config\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753115    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-kubernetes\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-systemd\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753164    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-tmp\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-netns\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753242    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-system-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753299    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-k8s-cni-cncf-io\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753367    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-cnibin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-multus-certs\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753409    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-var-lib-kubelet\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753429    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-multus-certs\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753433    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hct\" (UniqueName: \"kubernetes.io/projected/4a285c7d-4b71-4bbb-b0a4-7d2699005285-kube-api-access-r5hct\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753519    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-hostroot\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-netd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f3297b-9f00-4ffc-9cc6-697505b9613a-agent-certs\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753594    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-lib-modules\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-bin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-run\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-modprobe-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.753751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753714    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-tuned\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753747    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-bin\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysconfig\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753780    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-etc-kubernetes\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-os-release\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753846    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-d\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-systemd-units\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753906    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-systemd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-kubelet-config\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753937    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-slash\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753975    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-var-lib-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-env-overrides\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754035    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-os-release\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754096    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-system-cni-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/81f9ac9c-2479-48e8-9cff-de214c7a0566-dbus\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.754454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec2985c-9403-49fd-ba66-f5f36e348cf7-hosts-file\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754215    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-kubelet\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754249    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-etc-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754277    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovn-node-metrics-cert\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754318    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzwdn\" (UniqueName: \"kubernetes.io/projected/102b40db-894d-4243-843c-5230824ce815-kube-api-access-wzwdn\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-conf\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754415    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-sys\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-host\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-netns\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pt9\" (UniqueName: \"kubernetes.io/projected/aac66822-d301-461f-a00c-075b19c6e3f5-kube-api-access-k6pt9\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754581    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-ovn\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754630    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-kubelet\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-conf-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00f3297b-9f00-4ffc-9cc6-697505b9613a-konnectivity-ca\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.755193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754743    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-script-lib\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-systemd-units\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754829    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-kubernetes\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rxzc\" (UniqueName: \"kubernetes.io/projected/bcd67637-5c2b-4ae5-8753-2460a97e650b-kube-api-access-4rxzc\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754863    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-systemd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-cni-binary-copy\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754874    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-cni-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-multus\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-cnibin\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-var-lib-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-slash\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-socket-dir-parent\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.754983    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-cnibin\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-node-log\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755083    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-log-socket\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755129    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-systemd\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-env-overrides\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.756050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cec2985c-9403-49fd-ba66-f5f36e348cf7-tmp-dir\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-netns\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755692    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-var-lib-kubelet\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755871    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-os-release\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755931    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-system-cni-dir\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755974    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-host\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.755976    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-bin\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756016    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-hostroot\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-netns\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756070    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-etc-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-netd\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-ovn\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-run-ovn-kubernetes\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756440    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-multus-conf-dir\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.756021    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756524    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-cni-binary-copy\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757002 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.756533    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:50.256512007 +0000 UTC m=+3.088480115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756636    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-run-k8s-cni-cncf-io\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.753301    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-run-openvswitch\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-run\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756702    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-script-lib\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756756    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-cni-multus\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cec2985c-9403-49fd-ba66-f5f36e348cf7-hosts-file\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756825    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-etc-kubernetes\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/aac66822-d301-461f-a00c-075b19c6e3f5-os-release\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756850    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-cni-bin\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-sys\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.756975    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-sysctl-conf\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.757219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.757511    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/102b40db-894d-4243-843c-5230824ce815-multus-daemon-config\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.757224    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/102b40db-894d-4243-843c-5230824ce815-host-var-lib-kubelet\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.757602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcd67637-5c2b-4ae5-8753-2460a97e650b-host-kubelet\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.757891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.757742    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovnkube-config\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.758868 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.758360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/aac66822-d301-461f-a00c-075b19c6e3f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.759303 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.759061    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00f3297b-9f00-4ffc-9cc6-697505b9613a-agent-certs\") pod \"konnectivity-agent-lqpsg\" (UID: \"00f3297b-9f00-4ffc-9cc6-697505b9613a\") " pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.760406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.760379    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-tmp\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.760890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.760858    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4a285c7d-4b71-4bbb-b0a4-7d2699005285-etc-tuned\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.760989 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.760952    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bcd67637-5c2b-4ae5-8753-2460a97e650b-ovn-node-metrics-cert\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.773067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.772911    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk86r\" (UniqueName: \"kubernetes.io/projected/cec2985c-9403-49fd-ba66-f5f36e348cf7-kube-api-access-vk86r\") pod \"node-resolver-mjsfq\" (UID: \"cec2985c-9403-49fd-ba66-f5f36e348cf7\") " pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.776403 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.776356    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:49.776577 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.776413    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:49.776577 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.776431    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:49.776577 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:49.776521    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:06:50.276496493 +0000 UTC m=+3.108464604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:49.786846 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.786810    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pt9\" (UniqueName: \"kubernetes.io/projected/aac66822-d301-461f-a00c-075b19c6e3f5-kube-api-access-k6pt9\") pod \"multus-additional-cni-plugins-b6dqw\" (UID: \"aac66822-d301-461f-a00c-075b19c6e3f5\") " pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.787709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.787683    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hct\" (UniqueName: \"kubernetes.io/projected/4a285c7d-4b71-4bbb-b0a4-7d2699005285-kube-api-access-r5hct\") pod \"tuned-lsvkf\" (UID: \"4a285c7d-4b71-4bbb-b0a4-7d2699005285\") " pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.789807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.789416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rxzc\" (UniqueName: \"kubernetes.io/projected/bcd67637-5c2b-4ae5-8753-2460a97e650b-kube-api-access-4rxzc\") pod \"ovnkube-node-4b2l8\" (UID: \"bcd67637-5c2b-4ae5-8753-2460a97e650b\") " pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.789962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.789842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzwdn\" (UniqueName: \"kubernetes.io/projected/102b40db-894d-4243-843c-5230824ce815-kube-api-access-wzwdn\") pod \"multus-szxzj\" (UID: \"102b40db-894d-4243-843c-5230824ce815\") " pod="openshift-multus/multus-szxzj"
Aug 04 15:06:49.847630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.847598    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x5l8b"
Aug 04 15:06:49.856719 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.856537    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hglhm"
Aug 04 15:06:49.869855 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.869819    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj"
Aug 04 15:06:49.876824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.876786    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lsvkf"
Aug 04 15:06:49.886005 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.885966    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjsfq"
Aug 04 15:06:49.896254 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.896202    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-b6dqw"
Aug 04 15:06:49.905701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.905666    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:06:49.919453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.919342    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:06:49.927271 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:49.927133    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-szxzj"
Aug 04 15:06:50.158611 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.158523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:50.158805 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.158703    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:50.158805 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.158789    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:06:51.158766811 +0000 UTC m=+3.990734926 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:50.259013 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.258971    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:50.259215 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.259146    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:50.259287 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.259229    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:51.259206866 +0000 UTC m=+4.091174970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:50.359682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.359636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:50.359890 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.359777    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:50.359890 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.359806    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:50.359890 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.359817    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:50.359890 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.359872    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:06:51.359854002 +0000 UTC m=+4.191822118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:50.677797 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.677740    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:01:50 +0000 UTC" deadline="2028-01-18 09:12:52.343456355 +0000 UTC"
Aug 04 15:06:50.677797 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.677792    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12762h6m1.665668457s"
Aug 04 15:06:50.718174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:50.718140    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:50.718395 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:50.718298    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:50.923466 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.923435    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f3297b_9f00_4ffc_9cc6_697505b9613a.slice/crio-b9cd97bc73585556785590fc789cecbe983564cdab2481804f99ebdeaa7827f6 WatchSource:0}: Error finding container b9cd97bc73585556785590fc789cecbe983564cdab2481804f99ebdeaa7827f6: Status 404 returned error can't find the container with id b9cd97bc73585556785590fc789cecbe983564cdab2481804f99ebdeaa7827f6
Aug 04 15:06:50.925379 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.925348    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcd67637_5c2b_4ae5_8753_2460a97e650b.slice/crio-b0bf4985d2cba73e6c6c370e0e7c6ec8d0074e4b80faddf90c0ead56923b4cb7 WatchSource:0}: Error finding container b0bf4985d2cba73e6c6c370e0e7c6ec8d0074e4b80faddf90c0ead56923b4cb7: Status 404 returned error can't find the container with id b0bf4985d2cba73e6c6c370e0e7c6ec8d0074e4b80faddf90c0ead56923b4cb7
Aug 04 15:06:50.926233 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.926164    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a285c7d_4b71_4bbb_b0a4_7d2699005285.slice/crio-6095430d5eb2ec84d1e1ec858ee2f079d4802ef1fff48aa32e3ac869a9b2eaf1 WatchSource:0}: Error finding container 6095430d5eb2ec84d1e1ec858ee2f079d4802ef1fff48aa32e3ac869a9b2eaf1: Status 404 returned error can't find the container with id 6095430d5eb2ec84d1e1ec858ee2f079d4802ef1fff48aa32e3ac869a9b2eaf1
Aug 04 15:06:50.927417 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.927283    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16864864_2787_4792_9638_fea9159787ab.slice/crio-7d3f33db83d46f911c021cc1d656975effe818b58eb4bd94475889de4f12237b WatchSource:0}: Error finding container 7d3f33db83d46f911c021cc1d656975effe818b58eb4bd94475889de4f12237b: Status 404 returned error can't find the container with id 7d3f33db83d46f911c021cc1d656975effe818b58eb4bd94475889de4f12237b
Aug 04 15:06:50.928651 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.928600    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac66822_d301_461f_a00c_075b19c6e3f5.slice/crio-8ec4827b09faa5e4dd951b829cd57f47120b8d8d78d793ab133ff836691a1670 WatchSource:0}: Error finding container 8ec4827b09faa5e4dd951b829cd57f47120b8d8d78d793ab133ff836691a1670: Status 404 returned error can't find the container with id 8ec4827b09faa5e4dd951b829cd57f47120b8d8d78d793ab133ff836691a1670
Aug 04 15:06:50.932565 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.931687    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec2985c_9403_49fd_ba66_f5f36e348cf7.slice/crio-714977ce6f530facc00d3b44dbdb827989d522f6a7b1c53f450ca9aa12e35b48 WatchSource:0}: Error finding container 714977ce6f530facc00d3b44dbdb827989d522f6a7b1c53f450ca9aa12e35b48: Status 404 returned error can't find the container with id 714977ce6f530facc00d3b44dbdb827989d522f6a7b1c53f450ca9aa12e35b48
Aug 04 15:06:50.932881 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.932861    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25f6e80e_d6ec_49df_a7fa_d9d5e638d09e.slice/crio-9e56025e0494b5c72ae2f77c6267917f7374bffd63715dc3b804ea0bc2ed5015 WatchSource:0}: Error finding container 9e56025e0494b5c72ae2f77c6267917f7374bffd63715dc3b804ea0bc2ed5015: Status 404 returned error can't find the container with id 9e56025e0494b5c72ae2f77c6267917f7374bffd63715dc3b804ea0bc2ed5015
Aug 04 15:06:50.934764 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:06:50.934744    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod102b40db_894d_4243_843c_5230824ce815.slice/crio-78f7e53dd3db344d7c2be39dded91c3c8dac1512692cc50d1072f9928d09ca51 WatchSource:0}: Error finding container 78f7e53dd3db344d7c2be39dded91c3c8dac1512692cc50d1072f9928d09ca51: Status 404 returned error can't find the container with id 78f7e53dd3db344d7c2be39dded91c3c8dac1512692cc50d1072f9928d09ca51
Aug 04 15:06:51.165228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.165189    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:51.165380 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.165356    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:51.165452 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.165441    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:06:53.165424335 +0000 UTC m=+5.997392436 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:51.265753 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.265717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:51.265895 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.265852    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:51.265963 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.265925    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:53.265906014 +0000 UTC m=+6.097874117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:51.366732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.366705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:51.366907 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.366888    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:51.366945 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.366912    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:51.366945 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.366924    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:51.367022 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.366989    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:06:53.366975143 +0000 UTC m=+6.198943253 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:51.678605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.678522    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-03 15:01:50 +0000 UTC" deadline="2028-01-27 00:54:25.929594395 +0000 UTC"
Aug 04 15:06:51.678605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.678582    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12969h47m34.251017696s"
Aug 04 15:06:51.719534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.719503    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:51.719729 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.719645    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:51.719729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.719688    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:51.719847 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:51.719767    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:06:51.733502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.732742    2571 generic.go:356] "Generic (PLEG): container finished" podID="ac49cd09f4ea040536649438f74c9097" containerID="214ab8359f05993bd28b76623d50f53af4fc9cd7222e36b03856f947441e73b1" exitCode=0
Aug 04 15:06:51.733502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.732828    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal" event={"ID":"ac49cd09f4ea040536649438f74c9097","Type":"ContainerDied","Data":"214ab8359f05993bd28b76623d50f53af4fc9cd7222e36b03856f947441e73b1"}
Aug 04 15:06:51.736777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.736017    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal" event={"ID":"73bf5884360a6f56fb29aa28fa2e9510","Type":"ContainerStarted","Data":"aad94b1122ce6049ff80a47d890b985e105a61ad65e037cbafc5fced3eee569f"}
Aug 04 15:06:51.743752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.743711    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szxzj" event={"ID":"102b40db-894d-4243-843c-5230824ce815","Type":"ContainerStarted","Data":"78f7e53dd3db344d7c2be39dded91c3c8dac1512692cc50d1072f9928d09ca51"}
Aug 04 15:06:51.760023 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.759948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5l8b" event={"ID":"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e","Type":"ContainerStarted","Data":"9e56025e0494b5c72ae2f77c6267917f7374bffd63715dc3b804ea0bc2ed5015"}
Aug 04 15:06:51.765117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.765090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjsfq" event={"ID":"cec2985c-9403-49fd-ba66-f5f36e348cf7","Type":"ContainerStarted","Data":"714977ce6f530facc00d3b44dbdb827989d522f6a7b1c53f450ca9aa12e35b48"}
Aug 04 15:06:51.777056 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.776979    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerStarted","Data":"8ec4827b09faa5e4dd951b829cd57f47120b8d8d78d793ab133ff836691a1670"}
Aug 04 15:06:51.783309 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.783278    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lsvkf" event={"ID":"4a285c7d-4b71-4bbb-b0a4-7d2699005285","Type":"ContainerStarted","Data":"6095430d5eb2ec84d1e1ec858ee2f079d4802ef1fff48aa32e3ac869a9b2eaf1"}
Aug 04 15:06:51.788292 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.788262    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"b0bf4985d2cba73e6c6c370e0e7c6ec8d0074e4b80faddf90c0ead56923b4cb7"}
Aug 04 15:06:51.790071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.790045    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj" event={"ID":"788e6699-966c-4f65-b98b-a80ccc31f276","Type":"ContainerStarted","Data":"69bb3521ba7e745589081fcea9ad1a023f2fd9a9090e2f8965b72bb0efb49f47"}
Aug 04 15:06:51.796012 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.795984    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hglhm" event={"ID":"16864864-2787-4792-9638-fea9159787ab","Type":"ContainerStarted","Data":"7d3f33db83d46f911c021cc1d656975effe818b58eb4bd94475889de4f12237b"}
Aug 04 15:06:51.807546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:51.807512    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqpsg" event={"ID":"00f3297b-9f00-4ffc-9cc6-697505b9613a","Type":"ContainerStarted","Data":"b9cd97bc73585556785590fc789cecbe983564cdab2481804f99ebdeaa7827f6"}
Aug 04 15:06:52.718618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:52.718577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:52.719140 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:52.718748    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:52.839190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:52.839146    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal" event={"ID":"ac49cd09f4ea040536649438f74c9097","Type":"ContainerStarted","Data":"1bce455981c2db2bcad6ad189f12bcb7384b58f0beb60a18fd1d823da4bfd3a5"}
Aug 04 15:06:52.862426 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:52.862340    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-138.ec2.internal" podStartSLOduration=3.862313997 podStartE2EDuration="3.862313997s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:51.780932695 +0000 UTC m=+4.612900816" watchObservedRunningTime="2026-08-04 15:06:52.862313997 +0000 UTC m=+5.694282120"
Aug 04 15:06:53.185111 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:53.184993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:53.185282 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.185186    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:53.185282 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.185273    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:06:57.185252161 +0000 UTC m=+10.017220279 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:53.285715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:53.285669    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:53.285929 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.285832    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:53.285929 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.285901    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:06:57.285881775 +0000 UTC m=+10.117849880 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:53.387225 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:53.386476    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:53.387225 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.386709    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:53.387225 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.386736    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:53.387225 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.386751    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:53.387225 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.386825    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:06:57.386801844 +0000 UTC m=+10.218769963 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:53.718560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:53.718524    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:53.718751 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.718672    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:06:53.722539 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:53.718487    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:53.722698 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:53.722675    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:54.718427 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:54.718393    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:54.718617 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:54.718538    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:55.718793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:55.718719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:55.719232 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:55.718854    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:06:55.719232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:55.719192    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:55.719356 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:55.719326    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:56.718641 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:56.718165    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:56.718641 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:56.718296    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:57.219579 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:57.219543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:57.219877 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.219815    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:57.219968 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.219935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:07:05.219911333 +0000 UTC m=+18.051879444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:06:57.320881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:57.320816    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:57.321056 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.321020    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:57.321124 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.321090    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:05.321068576 +0000 UTC m=+18.153036691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:06:57.422304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:57.422272    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:57.422524 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.422505    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:06:57.422612 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.422537    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:06:57.422612 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.422551    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:57.422723 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.422616    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:07:05.422597642 +0000 UTC m=+18.254565756 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:06:57.719436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:57.718701    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:57.719436 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.718830    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:57.719436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:57.719210    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:57.719436 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:57.719304    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:06:58.717477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:58.717439    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:06:58.717678 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:58.717577    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:06:59.718079 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:59.718047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:06:59.718564 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:06:59.718047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:06:59.718564 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:59.718181    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:06:59.718564 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:06:59.718223    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:00.718136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:00.718108    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:00.718577 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:00.718238    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:01.717857 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:01.717824    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:01.718015 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:01.717924    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:01.718015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:01.717998    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:01.718094 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:01.718080    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:02.717703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:02.717671    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:02.718090 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:02.717809    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:03.717823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:03.717789    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:03.717823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:03.717812    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:03.718345 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:03.717925    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:03.718345 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:03.718247    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:04.717824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:04.717788    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:04.718034 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:04.717886    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:05.279894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:05.279864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:05.280093 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.280003    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:05.280093 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.280069    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:07:21.280048839 +0000 UTC m=+34.112016947 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:05.380808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:05.380776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:05.380949 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.380933    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:05.381020 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.380998    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:21.380982708 +0000 UTC m=+34.212950805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:05.481078 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:05.481045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:05.481213 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.481196    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:07:05.481286 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.481218    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:07:05.481286 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.481230    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:05.481286 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.481272    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:07:21.481257738 +0000 UTC m=+34.313225833 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:05.717647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:05.717619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:05.717806 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.717760    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:05.717871 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:05.717811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:05.717937 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:05.717916    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:06.718152 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:06.718121    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:06.718596 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:06.718248    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:07.718841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:07.718804    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:07.719282 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:07.718917    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:07.719282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:07.718974    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:07.719282 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:07.719031    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:08.717779 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:08.717747    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:08.717944 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:08.717871    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:09.718259 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:09.718221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:09.718723 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:09.718370    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:09.718723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:09.718451    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:09.718723 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:09.718556    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:10.717919 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.717639    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:10.718054 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:10.718026    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:10.878350 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.878318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjsfq" event={"ID":"cec2985c-9403-49fd-ba66-f5f36e348cf7","Type":"ContainerStarted","Data":"863f2cd9c4ffd5cff73524ca7955a83e9704399552467b0270fd6e19398cf57e"}
Aug 04 15:07:10.879780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.879755    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="57f2d785b7baf752d1ab131b1b2c92ccc597191c10cf5e04402ff8a4572925dd" exitCode=0
Aug 04 15:07:10.879882 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.879848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"57f2d785b7baf752d1ab131b1b2c92ccc597191c10cf5e04402ff8a4572925dd"}
Aug 04 15:07:10.881483 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.881435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lsvkf" event={"ID":"4a285c7d-4b71-4bbb-b0a4-7d2699005285","Type":"ContainerStarted","Data":"70ff6ebda17d7711dc6d106dd6e13e217b132298b03eed5b6d1244632d58d559"}
Aug 04 15:07:10.887461 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"bf0175a71235b9efda3f116d97a5caaf6f08531e88eb4bfe436e1d76a15bcf1d"}
Aug 04 15:07:10.887545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887521    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"d98383787ea74db7ee500348a25a90b548e69e78ce25261cb71ef3d86d6ba142"}
Aug 04 15:07:10.887602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887564    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"28925b71120eb05d39c62abc825b8cfc271872138e260e1b872ca87842f4cb42"}
Aug 04 15:07:10.887602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887596    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"70644d3ac4cc7342953e59042132479aee63b9feea824dc1c501ca41250a8c11"}
Aug 04 15:07:10.887692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"e8f2ab91fdc49f96ffe5e09e348c02498f8a1d57716c4a9edec51a504ca046a3"}
Aug 04 15:07:10.887692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.887666    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"9a4dd61f0d27b03ca809c78cb666c8e6e078de67b5574dab57451bd4b50f4592"}
Aug 04 15:07:10.888936 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.888911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj" event={"ID":"788e6699-966c-4f65-b98b-a80ccc31f276","Type":"ContainerStarted","Data":"3d7c703119b77bd4f20eeb5706eac84491e007fb276c2026be6729914621c3ce"}
Aug 04 15:07:10.890184 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.890164    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lqpsg" event={"ID":"00f3297b-9f00-4ffc-9cc6-697505b9613a","Type":"ContainerStarted","Data":"162c1ac4bc1c1bc4809ccc34401fd2788cfb6192ce1188bb20b81c0f230e7f3f"}
Aug 04 15:07:10.891575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.891558    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-szxzj" event={"ID":"102b40db-894d-4243-843c-5230824ce815","Type":"ContainerStarted","Data":"b7989735cb11d6d2f15491690b45a7570e25e803b23a09104b18bd8c7f59986a"}
Aug 04 15:07:10.892794 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.892773    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x5l8b" event={"ID":"25f6e80e-d6ec-49df-a7fa-d9d5e638d09e","Type":"ContainerStarted","Data":"c6e53f5451da54be30c5c136f459639dbe3f4888809c292bb20e1d58128bb370"}
Aug 04 15:07:10.898141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.898108    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjsfq" podStartSLOduration=3.80968856 podStartE2EDuration="22.898096763s" totalImagesPullingTime="19.088408203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:10.898070072 +0000 UTC m=+23.730038188" watchObservedRunningTime="2026-08-04 15:07:10.898096763 +0000 UTC m=+23.730064881"
Aug 04 15:07:10.898222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.898175    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-138.ec2.internal" podStartSLOduration=21.89816706 podStartE2EDuration="21.89816706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:06:52.862031262 +0000 UTC m=+5.693999383" watchObservedRunningTime="2026-08-04 15:07:10.89816706 +0000 UTC m=+23.730135175"
Aug 04 15:07:10.920953 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.920924    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lsvkf" podStartSLOduration=3.8118784249999997 podStartE2EDuration="22.920914519s" totalImagesPullingTime="19.109036094s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:10.920595745 +0000 UTC m=+23.752563862" watchObservedRunningTime="2026-08-04 15:07:10.920914519 +0000 UTC m=+23.752882635"
Aug 04 15:07:10.984905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:10.984876    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lqpsg" podStartSLOduration=11.579637786 podStartE2EDuration="22.98486537s" totalImagesPullingTime="11.405227584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:10.966857501 +0000 UTC m=+23.798825618" watchObservedRunningTime="2026-08-04 15:07:10.98486537 +0000 UTC m=+23.816833486"
Aug 04 15:07:11.006190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.006157    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x5l8b" podStartSLOduration=3.919278446 podStartE2EDuration="23.006145848s" totalImagesPullingTime="19.086867402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:10.984661867 +0000 UTC m=+23.816629983" watchObservedRunningTime="2026-08-04 15:07:11.006145848 +0000 UTC m=+23.838113966"
Aug 04 15:07:11.006344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.006323    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-szxzj" podStartSLOduration=2.867725449 podStartE2EDuration="22.006312583s" totalImagesPullingTime="19.138587134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:11.005924091 +0000 UTC m=+23.837892209" watchObservedRunningTime="2026-08-04 15:07:11.006312583 +0000 UTC m=+23.838280698"
Aug 04 15:07:11.374810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.374780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:11.718477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.718449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:11.718637 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.718476    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:11.718637 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:11.718564    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:11.718756 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:11.718717    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:11.895448 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.895410    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hglhm" event={"ID":"16864864-2787-4792-9638-fea9159787ab","Type":"ContainerStarted","Data":"8152c2cbfda9ef5c55aecf48c834a1983cfeb2d9e35712e5515045fb8d5e4b4a"}
Aug 04 15:07:11.949662 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.949614    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hglhm" podStartSLOduration=4.857012746 podStartE2EDuration="23.949592741s" totalImagesPullingTime="19.092579995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:11.949495814 +0000 UTC m=+24.781463934" watchObservedRunningTime="2026-08-04 15:07:11.949592741 +0000 UTC m=+24.781560860"
Aug 04 15:07:11.953019 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.952996    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:07:11.953502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:11.953483    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:07:12.075222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.075199    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.076703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.076684    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 04 15:07:12.340277 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.340203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.446609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.446577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.545401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.545372    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.607369 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.605825    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-04T15:07:12.076699582Z","UUID":"00fddf56-8c0c-40ed-b357-76b6e187c0cf","Handler":null,"Name":"","Endpoint":""}
Aug 04 15:07:12.607749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.607710    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 04 15:07:12.607844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.607772    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 04 15:07:12.652305 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.652261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.718172 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.718154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:12.718265 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:12.718246    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:12.774278 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.774250    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:12.899989 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.899959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj" event={"ID":"788e6699-966c-4f65-b98b-a80ccc31f276","Type":"ContainerStarted","Data":"3d744a43d54e66e12020c226c61a6e6607ba8a3e8c4f74a149fdd3a6701198d9"}
Aug 04 15:07:12.900571 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.900552    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:07:12.901084 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.901061    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lqpsg"
Aug 04 15:07:12.924945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:12.924920    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:13.116906 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.116867    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:13.718247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.718221    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:13.718422 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.718411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:13.718487 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:13.718420    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:13.718545 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:13.718507    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:13.905780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.905748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"bfa6a7db9e4a0c86739ca7c6c8885cebc8d97d295a3766e631254d80056f90e9"}
Aug 04 15:07:13.908413 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.908381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj" event={"ID":"788e6699-966c-4f65-b98b-a80ccc31f276","Type":"ContainerStarted","Data":"de45e5ab63f725f48456691f1ca8b8437f4cd1a7dcd4b6e7e530ed7b482c1f12"}
Aug 04 15:07:13.936692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:13.936654    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m4srj" podStartSLOduration=4.040232977 podStartE2EDuration="25.936641118s" totalImagesPullingTime="21.896408141s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:13.935957019 +0000 UTC m=+26.767925137" watchObservedRunningTime="2026-08-04 15:07:13.936641118 +0000 UTC m=+26.768609234"
Aug 04 15:07:14.132714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:14.132658    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:14.535590 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:14.535510    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:14.718070 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:14.718032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:14.718218 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:14.718169    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:15.186211 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.186035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:15.262800 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.262773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:15.718226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.718195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:15.718421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.718203    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:15.718421 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:15.718329    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:15.718421 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:15.718412    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:15.879011 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.878979    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:15.969661 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:15.969607    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.136078 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.136047    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.520732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.520675    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.718304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.718259    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:16.718482 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:16.718384    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:16.754045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.754016    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.875992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.875919    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.917133 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.917102    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="f330339ec8374b0c95ca350479b36176ac884f1ddc254cecf68b19c53454ff07" exitCode=0
Aug 04 15:07:16.917281 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.917187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"f330339ec8374b0c95ca350479b36176ac884f1ddc254cecf68b19c53454ff07"}
Aug 04 15:07:16.921076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.921051    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" event={"ID":"bcd67637-5c2b-4ae5-8753-2460a97e650b","Type":"ContainerStarted","Data":"64eb7f03279cd23eff9ad44f2e59acf4f24cda50bb1040ba0286e706db8852f4"}
Aug 04 15:07:16.921305 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.921280    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:16.936611 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.936580    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:16.971516 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.971483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:16.993120 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:16.993067    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8" podStartSLOduration=8.840732897 podStartE2EDuration="27.993045903s" totalImagesPullingTime="19.152313006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:16.989377645 +0000 UTC m=+29.821345762" watchObservedRunningTime="2026-08-04 15:07:16.993045903 +0000 UTC m=+29.825014019"
Aug 04 15:07:17.357536 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.357349    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:17.502506 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.502475    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:17.609782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.609701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:17.718960 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.718917    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:17.719145 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.718991    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:17.719145 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:17.719011    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:17.719145 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:17.719082    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:17.924039 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.924005    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:17.924248 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.924103    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:17.930008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.929978    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:17.939275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:17.939249    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:18.162394 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.162355    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:18.324244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.324203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:18.718346 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.718307    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:18.718831 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:18.718456    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:18.734894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.734857    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:18.928123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.928094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:18.928419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.928388    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="8f48789761bb5af372f31b2e2d0b46fbeb5ec4012a320ba845d489416e7cc9ab" exitCode=0
Aug 04 15:07:18.928541 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:18.928416    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"8f48789761bb5af372f31b2e2d0b46fbeb5ec4012a320ba845d489416e7cc9ab"}
Aug 04 15:07:19.537118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:19.537087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:19.718088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:19.718056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:19.718321 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:19.718193    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:19.718321 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:19.718234    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:19.718734 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:19.718333    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:19.923671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:19.923630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:20.133737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.133702    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:20.379656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.379622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:20.477660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.477547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:20.585898 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.585840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:20.718118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.718092    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:20.718244 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:20.718186    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:20.936864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.936840    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="e9ac08dbd91c12928ed4d98e99d02a593149edc21ccda0f880c663a86cd3cc39" exitCode=0
Aug 04 15:07:20.937199 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:20.936887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"e9ac08dbd91c12928ed4d98e99d02a593149edc21ccda0f880c663a86cd3cc39"}
Aug 04 15:07:21.132521 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.132497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:21.299389 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.299333    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:21.299496 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.299461    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:21.299534 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.299524    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs podName:6ed314ea-e70f-4be1-bf1f-62ac0cbd953a nodeName:}" failed. No retries permitted until 2026-08-04 15:07:53.299507195 +0000 UTC m=+66.131475291 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs") pod "network-metrics-daemon-dsrmg" (UID: "6ed314ea-e70f-4be1-bf1f-62ac0cbd953a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 04 15:07:21.400357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.400334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:21.400457 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.400431    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:21.400498 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.400474    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret podName:81f9ac9c-2479-48e8-9cff-de214c7a0566 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:53.40046074 +0000 UTC m=+66.232428852 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret") pod "global-pull-secret-syncer-lchxp" (UID: "81f9ac9c-2479-48e8-9cff-de214c7a0566") : object "kube-system"/"original-pull-secret" not registered
Aug 04 15:07:21.500779 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.500757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:21.500936 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.500915    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 04 15:07:21.500988 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.500978    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 04 15:07:21.501031 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.500994    2571 projected.go:196] Error preparing data for projected volume kube-api-access-87bvw for pod openshift-network-diagnostics/network-check-target-6zkwp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:21.501078 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.501047    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw podName:562f6d71-e376-49d0-9356-be4913af859c nodeName:}" failed. No retries permitted until 2026-08-04 15:07:53.501033958 +0000 UTC m=+66.333002066 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-87bvw" (UniqueName: "kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw") pod "network-check-target-6zkwp" (UID: "562f6d71-e376-49d0-9356-be4913af859c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 04 15:07:21.718155 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.718131    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:21.718155 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.718141    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:21.718345 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.718216    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:21.718408 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:21.718382    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:21.740414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.740390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:21.980146 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:21.980063    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:22.148692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:22.148662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:22.519104 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:22.519068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:22.717762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:22.717727    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:22.717952 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:22.717866    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:22.724199 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:22.724156    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:23.718110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:23.718076    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:23.718520 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:23.718199    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:23.718520 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:23.718264    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:23.718520 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:23.718374    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:23.913238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:23.913208    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:24.012799 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.012727    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:24.092081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.092046    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:24.385467 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.385434    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:24.488910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.488876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:24.718006 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.717931    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:24.718149 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:24.718043    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:24.976738 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:24.976660    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:25.362453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:25.362362    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:25.717884 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:25.717851    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:25.718071 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:25.717986    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:25.718145 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:25.718116    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:25.718201 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:25.718168    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:26.268581 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.268523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:26.357206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.357175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:26.632680 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.632651    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:26.718424 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.718398    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:26.718775 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:26.718492    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:26.732534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.732512    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:26.956098 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.956019    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="5fe3ebf19301a08e58a09f4f50d9942bf10d9d9927ad986c6c52ff5042e03fcd" exitCode=0
Aug 04 15:07:26.956098 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:26.956059    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"5fe3ebf19301a08e58a09f4f50d9942bf10d9d9927ad986c6c52ff5042e03fcd"}
Aug 04 15:07:27.718385 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:27.718348    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:27.718566 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:27.718469    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:27.718566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:27.718511    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:27.718973 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:27.718581    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:27.961093 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:27.961059    2571 generic.go:356] "Generic (PLEG): container finished" podID="aac66822-d301-461f-a00c-075b19c6e3f5" containerID="3a67865ba584bdfd403fdf091b4a13d5e9040005960bac382e08b80d5f82b4cc" exitCode=0
Aug 04 15:07:27.961245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:27.961117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerDied","Data":"3a67865ba584bdfd403fdf091b4a13d5e9040005960bac382e08b80d5f82b4cc"}
Aug 04 15:07:28.717701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:28.717678    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:28.717846 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:28.717777    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:28.965508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:28.965478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" event={"ID":"aac66822-d301-461f-a00c-075b19c6e3f5","Type":"ContainerStarted","Data":"ca081059a4927779e568eff63c2d3be4721ec97e8e0aedc792bba408a6640ee8"}
Aug 04 15:07:28.999689 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:28.999619    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-b6dqw" podStartSLOduration=9.131356146 podStartE2EDuration="40.999605567s" totalImagesPullingTime="31.868249421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:28.999468208 +0000 UTC m=+41.831436325" watchObservedRunningTime="2026-08-04 15:07:28.999605567 +0000 UTC m=+41.831573683"
Aug 04 15:07:29.717770 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.717739    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:29.717917 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:29.717850    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:29.717917 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.717908    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:29.718030 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:29.718009    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:29.718623 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.718601    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:29.826949 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.826926    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:29.923436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.923419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:29.997158 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:29.997091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:30.717881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:30.717850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:30.718025 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:30.717946    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:30.801533 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:30.801502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:30.878345 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:30.878318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:31.718127 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:31.718100    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:31.718127 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:31.718117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:31.718499 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:31.718206    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:31.718499 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:31.718349    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:31.719834 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:31.719807    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:32.006807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:32.006743    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:32.139276 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:32.139249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:32.282619 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:32.282514    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:32.718343 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:32.718315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:32.718729 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:32.718426    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:32.951987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:32.951961    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:33.175404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.175249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:33.385466 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.385443    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lchxp"]
Aug 04 15:07:33.385587 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.385528    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:33.385647 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:33.385608    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:33.393904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.393881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6zkwp"]
Aug 04 15:07:33.394035 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.393959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:33.394100 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:33.394047    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:33.404762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.404740    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dsrmg"]
Aug 04 15:07:33.404864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:33.404832    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:33.404958 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:33.404937    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:34.718162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:34.718134    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:34.718676 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:34.718248    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:34.718676 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:34.718315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:34.718676 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:34.718453    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:35.523759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:35.523726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:35.607511 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:35.607485    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:35.718002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:35.717975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:35.718124 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:35.718098    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:36.718222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:36.718193    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:36.718696 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:36.718193    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:36.718696 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:36.718330    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6zkwp" podUID="562f6d71-e376-49d0-9356-be4913af859c"
Aug 04 15:07:36.718696 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:36.718380    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lchxp" podUID="81f9ac9c-2479-48e8-9cff-de214c7a0566"
Aug 04 15:07:37.718627 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:37.718592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:37.719097 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:37.718701    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-dsrmg" podUID="6ed314ea-e70f-4be1-bf1f-62ac0cbd953a"
Aug 04 15:07:37.853726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:37.853655    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-138.ec2.internal" event="NodeReady"
Aug 04 15:07:37.853854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:37.853772    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 04 15:07:38.045622 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.045589    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wnzcd"]
Aug 04 15:07:38.064851 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.064831    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-km7n5"]
Aug 04 15:07:38.067632 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.065259    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.073723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.073699    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-46h4k\""
Aug 04 15:07:38.073823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.073766    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 04 15:07:38.073823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.073785    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 04 15:07:38.073823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.073804    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 04 15:07:38.073964 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.073926    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 04 15:07:38.077681 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.077664    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.082244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.082226    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 04 15:07:38.082348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.082270    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 04 15:07:38.082562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.082537    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-49dc4\""
Aug 04 15:07:38.082663 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.082634    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 04 15:07:38.096740 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.096700    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-km7n5"]
Aug 04 15:07:38.097853 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.097818    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnzcd"]
Aug 04 15:07:38.152965 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.152933    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jgmcm"]
Aug 04 15:07:38.167465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.167436    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.172441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.172418    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 04 15:07:38.172551 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.172444    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 04 15:07:38.172717 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.172702    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kghgl\""
Aug 04 15:07:38.188380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.188352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jgmcm"]
Aug 04 15:07:38.222759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222722    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9152172d-cfec-4b52-9150-e5914c7dbeed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.222759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq8jz\" (UniqueName: \"kubernetes.io/projected/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-api-access-bq8jz\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.222968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5109330-6309-451b-8a12-cdbc10db479a-cert\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.222968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222840    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfgk\" (UniqueName: \"kubernetes.io/projected/f5109330-6309-451b-8a12-cdbc10db479a-kube-api-access-thfgk\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.222968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9152172d-cfec-4b52-9150-e5914c7dbeed-crio-socket\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.222968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222920    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9152172d-cfec-4b52-9150-e5914c7dbeed-data-volume\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.222968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.222961    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.323477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323436    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5109330-6309-451b-8a12-cdbc10db479a-cert\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.323477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323478    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thfgk\" (UniqueName: \"kubernetes.io/projected/f5109330-6309-451b-8a12-cdbc10db479a-kube-api-access-thfgk\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnf8t\" (UniqueName: \"kubernetes.io/projected/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-kube-api-access-hnf8t\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323531    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9152172d-cfec-4b52-9150-e5914c7dbeed-crio-socket\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323554    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9152172d-cfec-4b52-9150-e5914c7dbeed-data-volume\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-config-volume\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-metrics-tls\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.323718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9152172d-cfec-4b52-9150-e5914c7dbeed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.324031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq8jz\" (UniqueName: \"kubernetes.io/projected/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-api-access-bq8jz\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.324031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323756    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9152172d-cfec-4b52-9150-e5914c7dbeed-crio-socket\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.324031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323882    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-tmp-dir\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.324031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.323971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9152172d-cfec-4b52-9150-e5914c7dbeed-data-volume\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.324242 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.324222    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.327572 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.327550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9152172d-cfec-4b52-9150-e5914c7dbeed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.327697 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.327677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5109330-6309-451b-8a12-cdbc10db479a-cert\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.337951 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.337925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfgk\" (UniqueName: \"kubernetes.io/projected/f5109330-6309-451b-8a12-cdbc10db479a-kube-api-access-thfgk\") pod \"ingress-canary-km7n5\" (UID: \"f5109330-6309-451b-8a12-cdbc10db479a\") " pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.359323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.359303    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq8jz\" (UniqueName: \"kubernetes.io/projected/9152172d-cfec-4b52-9150-e5914c7dbeed-kube-api-access-bq8jz\") pod \"insights-runtime-extractor-wnzcd\" (UID: \"9152172d-cfec-4b52-9150-e5914c7dbeed\") " pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.377266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.377243    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wnzcd"
Aug 04 15:07:38.385366 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.385347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-km7n5"
Aug 04 15:07:38.424620 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.424590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-metrics-tls\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.424745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.424643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-tmp-dir\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.424745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.424688    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnf8t\" (UniqueName: \"kubernetes.io/projected/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-kube-api-access-hnf8t\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.424745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.424732    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-config-volume\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.425094 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.425051    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-tmp-dir\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.425317 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.425284    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-config-volume\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.426755 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.426731    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-metrics-tls\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.444999 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.444971    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnf8t\" (UniqueName: \"kubernetes.io/projected/5ab41724-da7b-42b7-a4c7-e97f11a7f21c-kube-api-access-hnf8t\") pod \"dns-default-jgmcm\" (UID: \"5ab41724-da7b-42b7-a4c7-e97f11a7f21c\") " pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.475835 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.475790    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:38.547311 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.547012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:38.578034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.577924    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wnzcd"]
Aug 04 15:07:38.578311 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.578269    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-km7n5"]
Aug 04 15:07:38.580673 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:38.580650    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9152172d_cfec_4b52_9150_e5914c7dbeed.slice/crio-6b31476b2aa50f5b77f6fa236eba82ebdb2d9be217033519ee5eef78e9313d51 WatchSource:0}: Error finding container 6b31476b2aa50f5b77f6fa236eba82ebdb2d9be217033519ee5eef78e9313d51: Status 404 returned error can't find the container with id 6b31476b2aa50f5b77f6fa236eba82ebdb2d9be217033519ee5eef78e9313d51
Aug 04 15:07:38.584222 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:38.584193    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5109330_6309_451b_8a12_cdbc10db479a.slice/crio-91dc70aa74463a056b4aa9eb14a9d4669f18df835a994bc98f1029138ecc8a86 WatchSource:0}: Error finding container 91dc70aa74463a056b4aa9eb14a9d4669f18df835a994bc98f1029138ecc8a86: Status 404 returned error can't find the container with id 91dc70aa74463a056b4aa9eb14a9d4669f18df835a994bc98f1029138ecc8a86
Aug 04 15:07:38.646137 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.646098    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jgmcm"]
Aug 04 15:07:38.651160 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:38.651131    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab41724_da7b_42b7_a4c7_e97f11a7f21c.slice/crio-3b9d8a8070011200633f7747b7979d0bd1af6b52424911de9cbde1c20b2beb4b WatchSource:0}: Error finding container 3b9d8a8070011200633f7747b7979d0bd1af6b52424911de9cbde1c20b2beb4b: Status 404 returned error can't find the container with id 3b9d8a8070011200633f7747b7979d0bd1af6b52424911de9cbde1c20b2beb4b
Aug 04 15:07:38.683868 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.683840    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:38.718205 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.718170    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:38.718405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.718209    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:38.723329 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.723309    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 15:07:38.723808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.723470    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm4b6\""
Aug 04 15:07:38.723808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.723562    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 15:07:38.724095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.724083    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 15:07:38.988950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.988858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jgmcm" event={"ID":"5ab41724-da7b-42b7-a4c7-e97f11a7f21c","Type":"ContainerStarted","Data":"3b9d8a8070011200633f7747b7979d0bd1af6b52424911de9cbde1c20b2beb4b"}
Aug 04 15:07:38.989244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.989216    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:38.990088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.990067    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-km7n5" event={"ID":"f5109330-6309-451b-8a12-cdbc10db479a","Type":"ContainerStarted","Data":"91dc70aa74463a056b4aa9eb14a9d4669f18df835a994bc98f1029138ecc8a86"}
Aug 04 15:07:38.991446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.991426    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnzcd" event={"ID":"9152172d-cfec-4b52-9150-e5914c7dbeed","Type":"ContainerStarted","Data":"93f30dd3edc0fac14a20369e54bfa31e4548fcff39b53277e3bf522021cbef9d"}
Aug 04 15:07:38.991530 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:38.991466    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnzcd" event={"ID":"9152172d-cfec-4b52-9150-e5914c7dbeed","Type":"ContainerStarted","Data":"6b31476b2aa50f5b77f6fa236eba82ebdb2d9be217033519ee5eef78e9313d51"}
Aug 04 15:07:39.718477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:39.718437    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:39.723241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:39.723197    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8z69l\""
Aug 04 15:07:39.723241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:39.723193    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 15:07:39.996118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:39.996038    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnzcd" event={"ID":"9152172d-cfec-4b52-9150-e5914c7dbeed","Type":"ContainerStarted","Data":"a86112587addc96eb7de3113e452136bd667a8c50f07d299be20319885c3857f"}
Aug 04 15:07:40.943308 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:40.943260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:41.105935 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.105746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:41.248969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.248940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:41.810762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.810733    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:07:41.821338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.821312    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.826749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826555    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-txzf8\""
Aug 04 15:07:41.826749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826555    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 15:07:41.826749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826595    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 15:07:41.826749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826706    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 15:07:41.826749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826722    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 15:07:41.827086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.826845    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 15:07:41.828029 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.828010    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 15:07:41.828195 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.828054    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 15:07:41.832340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.832275    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:07:41.834387 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.834349    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 15:07:41.852255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852225    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852333    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh855\" (UniqueName: \"kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852423    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.852534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.852493    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.941491 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.941462    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:41.953510 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh855\" (UniqueName: \"kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953626    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953646    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.953902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.953677    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.954366 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.954313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.954479 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.954459    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.954479 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.954473    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.954608 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.954493    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.959095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.959077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.962812 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.959466    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:41.966335 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:41.966310    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh855\" (UniqueName: \"kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855\") pod \"console-6d9d6444b5-jfwwk\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") " pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:42.006128 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.006071    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jgmcm" event={"ID":"5ab41724-da7b-42b7-a4c7-e97f11a7f21c","Type":"ContainerStarted","Data":"6e81fdc207c6f7f91874bc10c79998a9d3182130cb62c66e7f8403e801fd411a"}
Aug 04 15:07:42.019759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.019739    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"]
Aug 04 15:07:42.035665 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.035643    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.039618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.039596    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nt7xc\""
Aug 04 15:07:42.039719 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.039637    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 04 15:07:42.040033 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.039862    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 04 15:07:42.040033 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.039865    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 04 15:07:42.040033 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.039920    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 04 15:07:42.041459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.041442    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 04 15:07:42.046574 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.046549    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"]
Aug 04 15:07:42.054881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.054845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.054981 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.054933    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438afc8-3ebd-4271-9559-a45d68b26cc7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.054981 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.054967    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.055139 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.054993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-957md\" (UniqueName: \"kubernetes.io/projected/c438afc8-3ebd-4271-9559-a45d68b26cc7-kube-api-access-957md\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.089152 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.089131    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:42.132353 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.132332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:42.156184 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.156167    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438afc8-3ebd-4271-9559-a45d68b26cc7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.156269 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.156192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.156269 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.156208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-957md\" (UniqueName: \"kubernetes.io/projected/c438afc8-3ebd-4271-9559-a45d68b26cc7-kube-api-access-957md\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.156269 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.156245    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.156447 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:42.156335    2571 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 04 15:07:42.156447 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:42.156387    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls podName:c438afc8-3ebd-4271-9559-a45d68b26cc7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:42.656373197 +0000 UTC m=+55.488341292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-5tpm6" (UID: "c438afc8-3ebd-4271-9559-a45d68b26cc7") : secret "prometheus-operator-tls" not found
Aug 04 15:07:42.156819 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.156796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c438afc8-3ebd-4271-9559-a45d68b26cc7-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.158380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.158364    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.166701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.166677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-957md\" (UniqueName: \"kubernetes.io/projected/c438afc8-3ebd-4271-9559-a45d68b26cc7-kube-api-access-957md\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.381192 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.381138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:42.451407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.451204    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:07:42.455631 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:42.455606    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f1f683_e74b_4ccd_b498_51021ee71843.slice/crio-fcc7087bd2596082a8567268d7993d00a7759aa59616fb2cd7f2406ac64ef786 WatchSource:0}: Error finding container fcc7087bd2596082a8567268d7993d00a7759aa59616fb2cd7f2406ac64ef786: Status 404 returned error can't find the container with id fcc7087bd2596082a8567268d7993d00a7759aa59616fb2cd7f2406ac64ef786
Aug 04 15:07:42.661814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.661785    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.665179 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.665159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/c438afc8-3ebd-4271-9559-a45d68b26cc7-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-5tpm6\" (UID: \"c438afc8-3ebd-4271-9559-a45d68b26cc7\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:42.818757 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.818721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:42.901196 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.901172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:42.947017 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:42.946963    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"
Aug 04 15:07:43.011407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.011378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jgmcm" event={"ID":"5ab41724-da7b-42b7-a4c7-e97f11a7f21c","Type":"ContainerStarted","Data":"aac7aee6754b2e6a9a4c6a4d69cba7fc33cf9bb9f7907447d11ac5f212c474bf"}
Aug 04 15:07:43.012121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.011512    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:43.013694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.013664    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wnzcd" event={"ID":"9152172d-cfec-4b52-9150-e5914c7dbeed","Type":"ContainerStarted","Data":"efeebc34391a571a370b007f2f6c9f9f68c1932b9147818661654e13039c6870"}
Aug 04 15:07:43.015085 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.015060    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-km7n5" event={"ID":"f5109330-6309-451b-8a12-cdbc10db479a","Type":"ContainerStarted","Data":"c26ec96883a501dc97f7844c2f60a09907923b84af3d22bd7afa9f0303b96cc4"}
Aug 04 15:07:43.016326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.016285    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6444b5-jfwwk" event={"ID":"16f1f683-e74b-4ccd-b498-51021ee71843","Type":"ContainerStarted","Data":"fcc7087bd2596082a8567268d7993d00a7759aa59616fb2cd7f2406ac64ef786"}
Aug 04 15:07:43.070856 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.070814    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jgmcm" podStartSLOduration=2.849370504 podStartE2EDuration="5.070798412s" totalImagesPullingTime="2.221427908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:43.0432219 +0000 UTC m=+55.875190018" watchObservedRunningTime="2026-08-04 15:07:43.070798412 +0000 UTC m=+55.902766528"
Aug 04 15:07:43.094840 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.094800    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-km7n5" podStartSLOduration=1.391833451 podStartE2EDuration="5.094786723s" totalImagesPullingTime="3.702953272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:43.093644719 +0000 UTC m=+55.925612837" watchObservedRunningTime="2026-08-04 15:07:43.094786723 +0000 UTC m=+55.926754848"
Aug 04 15:07:43.095146 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.095125    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wnzcd" podStartSLOduration=1.573888127 podStartE2EDuration="5.095119068s" totalImagesPullingTime="3.521230941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:07:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:43.070748522 +0000 UTC m=+55.902716639" watchObservedRunningTime="2026-08-04 15:07:43.095119068 +0000 UTC m=+55.927087179"
Aug 04 15:07:43.103927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:43.103905    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-5tpm6"]
Aug 04 15:07:43.107744 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:43.107696    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc438afc8_3ebd_4271_9559_a45d68b26cc7.slice/crio-5b446a85c39352e2189a0e4c6d26f50524b1a6785d422605e91ebc37df98324c WatchSource:0}: Error finding container 5b446a85c39352e2189a0e4c6d26f50524b1a6785d422605e91ebc37df98324c: Status 404 returned error can't find the container with id 5b446a85c39352e2189a0e4c6d26f50524b1a6785d422605e91ebc37df98324c
Aug 04 15:07:44.021093 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:44.021049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6" event={"ID":"c438afc8-3ebd-4271-9559-a45d68b26cc7","Type":"ContainerStarted","Data":"5b446a85c39352e2189a0e4c6d26f50524b1a6785d422605e91ebc37df98324c"}
Aug 04 15:07:44.309740 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:44.309482    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:44.488559 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:44.488523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:46.029736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.029642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6444b5-jfwwk" event={"ID":"16f1f683-e74b-4ccd-b498-51021ee71843","Type":"ContainerStarted","Data":"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"}
Aug 04 15:07:46.031519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.031496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6" event={"ID":"c438afc8-3ebd-4271-9559-a45d68b26cc7","Type":"ContainerStarted","Data":"14048ebe7a14783c1c6b9091bcd96d0c431385bc45e272380d1522852f58e91d"}
Aug 04 15:07:46.031634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.031535    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6" event={"ID":"c438afc8-3ebd-4271-9559-a45d68b26cc7","Type":"ContainerStarted","Data":"bf08c005541822fc62f51bf509ebe0b9a6a7b94f335e2c0acf18c4bf76bd05ea"}
Aug 04 15:07:46.090609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.089897    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d9d6444b5-jfwwk" podStartSLOduration=1.8071040900000002 podStartE2EDuration="5.089876297s" totalImagesPullingTime="3.282772207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:46.089403826 +0000 UTC m=+58.921371944" watchObservedRunningTime="2026-08-04 15:07:46.089876297 +0000 UTC m=+58.921844415"
Aug 04 15:07:46.113941 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.113887    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-5tpm6" podStartSLOduration=2.489773741 podStartE2EDuration="5.11386849s" totalImagesPullingTime="2.624094749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:46.112927129 +0000 UTC m=+58.944895247" watchObservedRunningTime="2026-08-04 15:07:46.11386849 +0000 UTC m=+58.945836606"
Aug 04 15:07:46.177423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:46.177388    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:47.769435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:47.769397    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:47.839154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:47.839123    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.271278 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.271240    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.495852 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.495818    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.639462 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.639429    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.708449 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.708415    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"]
Aug 04 15:07:48.728720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.728692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.730977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.730943    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"]
Aug 04 15:07:48.732551 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.732534    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tq266\""
Aug 04 15:07:48.732933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.732909    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 04 15:07:48.733043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.732954    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 04 15:07:48.779170 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.779131    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-x22xk"]
Aug 04 15:07:48.803590 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.803562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.804477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.804457    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"]
Aug 04 15:07:48.804606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.804589    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.807767 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.807749    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 04 15:07:48.808145 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.808130    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 04 15:07:48.808208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.808182    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 04 15:07:48.808304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.808269    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c87cf\""
Aug 04 15:07:48.808967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.808945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbngq\" (UniqueName: \"kubernetes.io/projected/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-kube-api-access-lbngq\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.809046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.809008    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.809102 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.809087    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.809148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.809118    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.824485 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.824462    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"]
Aug 04 15:07:48.824603 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.824583    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.827703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.827678    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Aug 04 15:07:48.827919 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.827902    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Aug 04 15:07:48.829285 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.829263    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-z7tcp\""
Aug 04 15:07:48.829398 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.829314    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Aug 04 15:07:48.889750 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.889671    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:48.909959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.909930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.910110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.909970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7l2l\" (UniqueName: \"kubernetes.io/projected/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-api-access-v7l2l\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.910110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.909994    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-wtmp\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.910110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910076    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.910110 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910105    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-root\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-accelerators-collector-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbngq\" (UniqueName: \"kubernetes.io/projected/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-kube-api-access-lbngq\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-tls\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-metrics-client-ca\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910221    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-sys\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-textfile\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.910686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910359    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.910686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910400    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sspdv\" (UniqueName: \"kubernetes.io/projected/e5826ad5-0c20-4154-a0cd-5954f57b7907-kube-api-access-sspdv\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:48.910686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.910686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.910582    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c283f7ba-0e3d-4b43-a340-d0379db742df-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:48.911141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.911121    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.912892 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.912873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.912977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.912959    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:48.920733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:48.920713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbngq\" (UniqueName: \"kubernetes.io/projected/1d8c98d3-80aa-4580-b0b3-90be7d4fca96-kube-api-access-lbngq\") pod \"openshift-state-metrics-6bb4d7b4dd-kzbfc\" (UID: \"1d8c98d3-80aa-4580-b0b3-90be7d4fca96\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:49.011252 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011220    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7l2l\" (UniqueName: \"kubernetes.io/projected/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-api-access-v7l2l\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.011252 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-wtmp\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011274    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011306    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-root\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-accelerators-collector-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-tls\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011408    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-root\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011424    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-wtmp\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011426    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-metrics-client-ca\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011482    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-sys\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011500    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-textfile\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011551    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5826ad5-0c20-4154-a0cd-5954f57b7907-sys\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011590    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.011905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011896    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-textfile\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.012183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.011993    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-metrics-client-ca\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.012183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012032    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sspdv\" (UniqueName: \"kubernetes.io/projected/e5826ad5-0c20-4154-a0cd-5954f57b7907-kube-api-access-sspdv\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.012183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012100    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c283f7ba-0e3d-4b43-a340-d0379db742df-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.012183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012155    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-metrics-client-ca\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.012401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012273    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.012455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c283f7ba-0e3d-4b43-a340-d0379db742df-volume-directive-shadow\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.012893 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.012864    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-accelerators-collector-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.013806 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.013783    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-tls\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.013914 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.013893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-tls\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.013986 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.013970    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5826ad5-0c20-4154-a0cd-5954f57b7907-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.014139 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.014123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.024793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.024774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7l2l\" (UniqueName: \"kubernetes.io/projected/c283f7ba-0e3d-4b43-a340-d0379db742df-kube-api-access-v7l2l\") pod \"kube-state-metrics-6bd9664c4-mh4jq\" (UID: \"c283f7ba-0e3d-4b43-a340-d0379db742df\") " pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.027119 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.027103    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sspdv\" (UniqueName: \"kubernetes.io/projected/e5826ad5-0c20-4154-a0cd-5954f57b7907-kube-api-access-sspdv\") pod \"node-exporter-x22xk\" (UID: \"e5826ad5-0c20-4154-a0cd-5954f57b7907\") " pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.038166 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.038150    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"
Aug 04 15:07:49.065186 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.065167    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.113111 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.113086    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-x22xk"
Aug 04 15:07:49.133984 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.133962    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"
Aug 04 15:07:49.143654 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:49.143625    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5826ad5_0c20_4154_a0cd_5954f57b7907.slice/crio-4d10d01ccd7815e862113642384ad43ac5fcf52229d319c6a5fbda86d80a73dd WatchSource:0}: Error finding container 4d10d01ccd7815e862113642384ad43ac5fcf52229d319c6a5fbda86d80a73dd: Status 404 returned error can't find the container with id 4d10d01ccd7815e862113642384ad43ac5fcf52229d319c6a5fbda86d80a73dd
Aug 04 15:07:49.164009 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.163980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.199814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.199694    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc"]
Aug 04 15:07:49.202472 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:49.202401    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8c98d3_80aa_4580_b0b3_90be7d4fca96.slice/crio-102a9ea87c77d8a1a7480638bbe6bb4b7d38e26f6488572ecf1c6c5987b854d7 WatchSource:0}: Error finding container 102a9ea87c77d8a1a7480638bbe6bb4b7d38e26f6488572ecf1c6c5987b854d7: Status 404 returned error can't find the container with id 102a9ea87c77d8a1a7480638bbe6bb4b7d38e26f6488572ecf1c6c5987b854d7
Aug 04 15:07:49.285718 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:49.285694    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc283f7ba_0e3d_4b43_a340_d0379db742df.slice/crio-754743bc6e2c468b943fc2eff555e8ef7f866f5b230d6fd8972f01a517236b9c WatchSource:0}: Error finding container 754743bc6e2c468b943fc2eff555e8ef7f866f5b230d6fd8972f01a517236b9c: Status 404 returned error can't find the container with id 754743bc6e2c468b943fc2eff555e8ef7f866f5b230d6fd8972f01a517236b9c
Aug 04 15:07:49.302416 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.302396    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq"]
Aug 04 15:07:49.406064 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.406037    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.505115 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.505083    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.520305 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.520276    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:07:49.533516 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.533492    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.536799 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.536779    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 15:07:49.537268 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537247    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 15:07:49.537482 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537468    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 15:07:49.537537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537484    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 15:07:49.537578 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 15:07:49.537670 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537636    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 15:07:49.537797 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537700    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 15:07:49.537797 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537771    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q9lpk\""
Aug 04 15:07:49.537916 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537827    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 15:07:49.537916 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.537882    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 15:07:49.543528 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.543510    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:07:49.610328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.610301    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.616377 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616382    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616403    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616420    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616472    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xtpw\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616605    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616622    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.616818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.616676    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.716939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.716886    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.716939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.716914    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xtpw\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.716939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.716932    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717100 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.716953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717277 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717244    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717400 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717341    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717447 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:49.717420    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle podName:efdc694f-08b0-41e3-9b0e-defe9c6e9ef7 nodeName:}" failed. No retries permitted until 2026-08-04 15:07:50.217400274 +0000 UTC m=+63.049368383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7") : configmap references non-existent config key: ca-bundle.crt
Aug 04 15:07:49.717515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717449    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717491    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717529    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717563    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.717869 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.718704 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.717422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720104    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720273 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720165    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720611    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720898 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720994 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.720994 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.720985    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.721175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.721156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.721650 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.721628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.721757 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.721712    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.732045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.732028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xtpw\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:49.814257 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.814229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:49.948552 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:49.948526    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4b2l8"
Aug 04 15:07:50.024347 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.023696    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jgmcm"
Aug 04 15:07:50.049203 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.049178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x22xk" event={"ID":"e5826ad5-0c20-4154-a0cd-5954f57b7907","Type":"ContainerStarted","Data":"4d10d01ccd7815e862113642384ad43ac5fcf52229d319c6a5fbda86d80a73dd"}
Aug 04 15:07:50.050669 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.050642    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq" event={"ID":"c283f7ba-0e3d-4b43-a340-d0379db742df","Type":"ContainerStarted","Data":"754743bc6e2c468b943fc2eff555e8ef7f866f5b230d6fd8972f01a517236b9c"}
Aug 04 15:07:50.053154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.053125    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc" event={"ID":"1d8c98d3-80aa-4580-b0b3-90be7d4fca96","Type":"ContainerStarted","Data":"7736395ac83402ff4c2b54a054ec7c7e1abe4da59dbff862f76fb9448dd1fd89"}
Aug 04 15:07:50.053266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.053181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc" event={"ID":"1d8c98d3-80aa-4580-b0b3-90be7d4fca96","Type":"ContainerStarted","Data":"54042e554faf4416fcd62ae2cfade0ed487d2a50ce555196272ce778ad32350a"}
Aug 04 15:07:50.053266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.053214    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc" event={"ID":"1d8c98d3-80aa-4580-b0b3-90be7d4fca96","Type":"ContainerStarted","Data":"102a9ea87c77d8a1a7480638bbe6bb4b7d38e26f6488572ecf1c6c5987b854d7"}
Aug 04 15:07:50.132622 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.132585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:50.222852 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.222810    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:50.224065 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.224018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:50.225033 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.225007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:50.412520 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.412480    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:50.443734 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.443706    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:07:50.503699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.503667    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:50.697474 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.697391    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"]
Aug 04 15:07:50.700230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.700205    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.703986 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.703954    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 04 15:07:50.704563 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704544    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 04 15:07:50.704686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704551    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 04 15:07:50.704737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704724    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 04 15:07:50.704824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704805    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-fr9bx\""
Aug 04 15:07:50.704878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704839    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 04 15:07:50.704977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.704953    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fu9omup9cr0su\""
Aug 04 15:07:50.728508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728470    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728531    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251c5559-fde4-408d-a22c-dad05e4fe2e9-metrics-client-ca\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728591    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fhqj\" (UniqueName: \"kubernetes.io/projected/251c5559-fde4-408d-a22c-dad05e4fe2e9-kube-api-access-5fhqj\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728758    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728790    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-grpc-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.728883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.728857    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.730419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.730391    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"]
Aug 04 15:07:50.829904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.829853    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.829904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.829912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-grpc-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.829947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.829980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.830036    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.830065    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251c5559-fde4-408d-a22c-dad05e4fe2e9-metrics-client-ca\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.830091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fhqj\" (UniqueName: \"kubernetes.io/projected/251c5559-fde4-408d-a22c-dad05e4fe2e9-kube-api-access-5fhqj\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.830487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.830140    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.831140 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.831110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/251c5559-fde4-408d-a22c-dad05e4fe2e9-metrics-client-ca\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.833100 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.833062    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.833638 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.833610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.833774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.833752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.833844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.833813    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-grpc-tls\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.833898 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.833846    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.834179 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.834161    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/251c5559-fde4-408d-a22c-dad05e4fe2e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:50.845569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:50.845535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fhqj\" (UniqueName: \"kubernetes.io/projected/251c5559-fde4-408d-a22c-dad05e4fe2e9-kube-api-access-5fhqj\") pod \"thanos-querier-6fbdbc8b7-g854l\" (UID: \"251c5559-fde4-408d-a22c-dad05e4fe2e9\") " pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:51.011255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.011182    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:51.061104 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.060989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x22xk" event={"ID":"e5826ad5-0c20-4154-a0cd-5954f57b7907","Type":"ContainerStarted","Data":"b6193539e62949595d29a34b54ba495a515f14e337c9cbadd26d4b3051852ce0"}
Aug 04 15:07:51.070027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.068947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq" event={"ID":"c283f7ba-0e3d-4b43-a340-d0379db742df","Type":"ContainerStarted","Data":"55113b4fddecf79421d3794e79b4ca0584a1ad285e3e162f0403e64880358b39"}
Aug 04 15:07:51.077337 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.076494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc" event={"ID":"1d8c98d3-80aa-4580-b0b3-90be7d4fca96","Type":"ContainerStarted","Data":"fa043b4343a5c7468500a4577dfe545c13f54716151adcbc5bba9434609f112b"}
Aug 04 15:07:51.130656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.130536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:07:51.164551 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:51.164502    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefdc694f_08b0_41e3_9b0e_defe9c6e9ef7.slice/crio-4333ea67fc2b4ecd9ea3d1db977e161c97afb3ee45ae1c0b77c947a6055f4497 WatchSource:0}: Error finding container 4333ea67fc2b4ecd9ea3d1db977e161c97afb3ee45ae1c0b77c947a6055f4497: Status 404 returned error can't find the container with id 4333ea67fc2b4ecd9ea3d1db977e161c97afb3ee45ae1c0b77c947a6055f4497
Aug 04 15:07:51.228762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.228652    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-kzbfc" podStartSLOduration=1.734181797 podStartE2EDuration="3.228631074s" totalImagesPullingTime="1.494449277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:51.228081849 +0000 UTC m=+64.060049967" watchObservedRunningTime="2026-08-04 15:07:51.228631074 +0000 UTC m=+64.060599191"
Aug 04 15:07:51.231758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.231728    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"]
Aug 04 15:07:51.239801 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:51.239733    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251c5559_fde4_408d_a22c_dad05e4fe2e9.slice/crio-bf4005310e73d8876b8d92c6c3229d833bef3791a0dde24bc8835c609c0989c0 WatchSource:0}: Error finding container bf4005310e73d8876b8d92c6c3229d833bef3791a0dde24bc8835c609c0989c0: Status 404 returned error can't find the container with id bf4005310e73d8876b8d92c6c3229d833bef3791a0dde24bc8835c609c0989c0
Aug 04 15:07:51.333903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.333865    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:51.460514 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.460464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:51.742869 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.742838    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:51.843560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.843520    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:51.945044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:51.945008    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:52.054330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.054239    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:52.082376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.082338    2571 generic.go:356] "Generic (PLEG): container finished" podID="e5826ad5-0c20-4154-a0cd-5954f57b7907" containerID="b6193539e62949595d29a34b54ba495a515f14e337c9cbadd26d4b3051852ce0" exitCode=0
Aug 04 15:07:52.082552 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.082423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x22xk" event={"ID":"e5826ad5-0c20-4154-a0cd-5954f57b7907","Type":"ContainerDied","Data":"b6193539e62949595d29a34b54ba495a515f14e337c9cbadd26d4b3051852ce0"}
Aug 04 15:07:52.083920 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.083839    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"bf4005310e73d8876b8d92c6c3229d833bef3791a0dde24bc8835c609c0989c0"}
Aug 04 15:07:52.085226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.085140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"4333ea67fc2b4ecd9ea3d1db977e161c97afb3ee45ae1c0b77c947a6055f4497"}
Aug 04 15:07:52.087633 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.087605    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq" event={"ID":"c283f7ba-0e3d-4b43-a340-d0379db742df","Type":"ContainerStarted","Data":"c72d2c7cc50d3dcad24c7905fa5799952de238f6e0213d8094a9f01a8e92baa3"}
Aug 04 15:07:52.087746 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.087670    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq" event={"ID":"c283f7ba-0e3d-4b43-a340-d0379db742df","Type":"ContainerStarted","Data":"79fd7f0b96472bc8c5b281f88689f90c854f5ba2de8daabdc85c3fe6878f5497"}
Aug 04 15:07:52.132716 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.132689    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:52.132855 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.132789    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:52.138564 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.138541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:52.144122 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.144049    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-6bd9664c4-mh4jq" podStartSLOduration=2.535015481 podStartE2EDuration="4.144031492s" totalImagesPullingTime="1.609016011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:52.142068256 +0000 UTC m=+64.974036374" watchObservedRunningTime="2026-08-04 15:07:52.144031492 +0000 UTC m=+64.975999611"
Aug 04 15:07:52.773502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:52.773464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:53.093970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.093891    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x22xk" event={"ID":"e5826ad5-0c20-4154-a0cd-5954f57b7907","Type":"ContainerStarted","Data":"417dc3f21e52820c91cacc0bfcb0dc1c6115f023b7acc0efdfd1ef209871a4af"}
Aug 04 15:07:53.093970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.093948    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-x22xk" event={"ID":"e5826ad5-0c20-4154-a0cd-5954f57b7907","Type":"ContainerStarted","Data":"044e1ce02bc8c9f5fe89be11382ef87a7af7651d1c1cbefac84f903d9593ce83"}
Aug 04 15:07:53.095640 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.095610    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273" exitCode=0
Aug 04 15:07:53.095753 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.095694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273"}
Aug 04 15:07:53.100044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.100025    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:07:53.145580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.145530    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-x22xk" podStartSLOduration=3.289131275 podStartE2EDuration="5.145512483s" totalImagesPullingTime="1.746908366s" totalInitContainerRuntime="109.472842ms" isStatefulPod=true podCreationTimestamp="2026-08-04 15:07:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:53.142867791 +0000 UTC m=+65.974835920" watchObservedRunningTime="2026-08-04 15:07:53.145512483 +0000 UTC m=+65.977480604"
Aug 04 15:07:53.262545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.262270    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"]
Aug 04 15:07:53.265170 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.265141    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.267713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.267689    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"]
Aug 04 15:07:53.269556 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.269467    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.270801 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.270784    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Aug 04 15:07:53.270890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.270858    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Aug 04 15:07:53.271088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.271068    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Aug 04 15:07:53.271357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.271337    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-16a4gbmkvvvdv\""
Aug 04 15:07:53.271456 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.271418    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-kgcgp\""
Aug 04 15:07:53.271515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.271501    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Aug 04 15:07:53.277221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.277200    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Aug 04 15:07:53.277536 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.277515    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rjdhl\""
Aug 04 15:07:53.277656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.277631    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"]
Aug 04 15:07:53.302745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.302723    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"]
Aug 04 15:07:53.353987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.353902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-metrics-server-audit-profiles\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.353987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.353947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.353987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.353977    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ct7bm\" (UniqueName: \"kubernetes.io/projected/e5a352ff-b031-4b99-bb43-ed576458b033-kube-api-access-ct7bm\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.354207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354089    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-client-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.354207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354110    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:53.354207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-tls\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.354207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5a352ff-b031-4b99-bb43-ed576458b033-audit-log\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.354465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/27b8aac7-b51f-42d4-8448-45e040840f7c-kube-api-access-wflhj\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.354465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-client-certs\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.354465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.354275    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27b8aac7-b51f-42d4-8448-45e040840f7c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.356961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.356942    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 04 15:07:53.367303 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.367269    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ed314ea-e70f-4be1-bf1f-62ac0cbd953a-metrics-certs\") pod \"network-metrics-daemon-dsrmg\" (UID: \"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a\") " pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:53.454830 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-client-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.454937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454840    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-tls\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.454937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454868    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:53.454937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5a352ff-b031-4b99-bb43-ed576458b033-audit-log\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.454937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454931    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/27b8aac7-b51f-42d4-8448-45e040840f7c-kube-api-access-wflhj\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.455131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454970    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-client-certs\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.455131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.454996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27b8aac7-b51f-42d4-8448-45e040840f7c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.455131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.455045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-metrics-server-audit-profiles\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.455131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.455083    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.455131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.455112    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ct7bm\" (UniqueName: \"kubernetes.io/projected/e5a352ff-b031-4b99-bb43-ed576458b033-kube-api-access-ct7bm\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.455774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.455720    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e5a352ff-b031-4b99-bb43-ed576458b033-audit-log\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.456056 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.456018    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.456469 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.456438    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e5a352ff-b031-4b99-bb43-ed576458b033-metrics-server-audit-profiles\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.457230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.457213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-client-ca-bundle\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.457575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.457553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-tls\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.457945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.457925    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/27b8aac7-b51f-42d4-8448-45e040840f7c-monitoring-plugin-cert\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.458002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.457986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e5a352ff-b031-4b99-bb43-ed576458b033-secret-metrics-server-client-certs\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.460795 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.460773    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 04 15:07:53.467726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.467709    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/81f9ac9c-2479-48e8-9cff-de214c7a0566-original-pull-secret\") pod \"global-pull-secret-syncer-lchxp\" (UID: \"81f9ac9c-2479-48e8-9cff-de214c7a0566\") " pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:53.469947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.469918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wflhj\" (UniqueName: \"kubernetes.io/projected/27b8aac7-b51f-42d4-8448-45e040840f7c-kube-api-access-wflhj\") pod \"monitoring-plugin-6dffbbd67-2wmv7\" (UID: \"27b8aac7-b51f-42d4-8448-45e040840f7c\") " pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.474599 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.474578    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ct7bm\" (UniqueName: \"kubernetes.io/projected/e5a352ff-b031-4b99-bb43-ed576458b033-kube-api-access-ct7bm\") pod \"metrics-server-7cbb4d558c-kzmzp\" (UID: \"e5a352ff-b031-4b99-bb43-ed576458b033\") " pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.517267 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.517243    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:53.532346 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.532326    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8z69l\""
Aug 04 15:07:53.540338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.540322    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-dsrmg"
Aug 04 15:07:53.555993 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.555968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:53.560980 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.560959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 04 15:07:53.571807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.571788    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 04 15:07:53.577763 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.577743    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:07:53.580410 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.580387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87bvw\" (UniqueName: \"kubernetes.io/projected/562f6d71-e376-49d0-9356-be4913af859c-kube-api-access-87bvw\") pod \"network-check-target-6zkwp\" (UID: \"562f6d71-e376-49d0-9356-be4913af859c\") " pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:53.584144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.584126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:07:53.612960 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.612897    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:53.679923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.679664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-dsrmg"]
Aug 04 15:07:53.682927 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:53.682896    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ed314ea_e70f_4be1_bf1f_62ac0cbd953a.slice/crio-43de1bc4db37c2379baaf88cd91dc31cd15c468eedd42d0ca5f48b674754a4e6 WatchSource:0}: Error finding container 43de1bc4db37c2379baaf88cd91dc31cd15c468eedd42d0ca5f48b674754a4e6: Status 404 returned error can't find the container with id 43de1bc4db37c2379baaf88cd91dc31cd15c468eedd42d0ca5f48b674754a4e6
Aug 04 15:07:53.727987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.727964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lchxp"
Aug 04 15:07:53.734218 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.734188    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"]
Aug 04 15:07:53.736794 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:53.736760    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5a352ff_b031_4b99_bb43_ed576458b033.slice/crio-985bbb67310af78ebf5fb333467afdfa7923859670716296706c57460a83ce99 WatchSource:0}: Error finding container 985bbb67310af78ebf5fb333467afdfa7923859670716296706c57460a83ce99: Status 404 returned error can't find the container with id 985bbb67310af78ebf5fb333467afdfa7923859670716296706c57460a83ce99
Aug 04 15:07:53.738659 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.738544    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jm4b6\""
Aug 04 15:07:53.743032 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.743014    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:07:53.748891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.748867    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"]
Aug 04 15:07:53.751857 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:53.751835    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27b8aac7_b51f_42d4_8448_45e040840f7c.slice/crio-a886c14fec86c5790adf5bab6ecd7da7d4ab009409f7aac453af2a1fd99bb431 WatchSource:0}: Error finding container a886c14fec86c5790adf5bab6ecd7da7d4ab009409f7aac453af2a1fd99bb431: Status 404 returned error can't find the container with id a886c14fec86c5790adf5bab6ecd7da7d4ab009409f7aac453af2a1fd99bb431
Aug 04 15:07:53.881235 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.881206    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lchxp"]
Aug 04 15:07:53.886089 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:53.886055    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f9ac9c_2479_48e8_9cff_de214c7a0566.slice/crio-82ea4d13573553b40a5964c9bb752c851ea6740504ced072d94572f806af20e0 WatchSource:0}: Error finding container 82ea4d13573553b40a5964c9bb752c851ea6740504ced072d94572f806af20e0: Status 404 returned error can't find the container with id 82ea4d13573553b40a5964c9bb752c851ea6740504ced072d94572f806af20e0
Aug 04 15:07:53.906601 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:53.906572    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6zkwp"]
Aug 04 15:07:53.909140 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:53.909107    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod562f6d71_e376_49d0_9356_be4913af859c.slice/crio-f80369dad4d36f303960983c58fdfebd61748e878bbe3af0ed9e7edc00c9c56c WatchSource:0}: Error finding container f80369dad4d36f303960983c58fdfebd61748e878bbe3af0ed9e7edc00c9c56c: Status 404 returned error can't find the container with id f80369dad4d36f303960983c58fdfebd61748e878bbe3af0ed9e7edc00c9c56c
Aug 04 15:07:54.040540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.040512    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:07:54.043469 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.043451    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.060025 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.059996    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"]
Aug 04 15:07:54.063615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.063593    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:07:54.063733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.063683    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.066688 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.066619    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"telemeter-client-serving-certs-ca-bundle\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" type="*v1.ConfigMap"
Aug 04 15:07:54.066688 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.066623    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"federate-client-certs\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" type="*v1.Secret"
Aug 04 15:07:54.067010 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.066981    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"telemeter-client-dockercfg-x8qjj\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x8qjj\"" type="*v1.Secret"
Aug 04 15:07:54.067387 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.067353    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"telemeter-client-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" type="*v1.Secret"
Aug 04 15:07:54.067500 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.067431    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"telemeter-client\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" type="*v1.Secret"
Aug 04 15:07:54.067618 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.067588    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"telemeter-client-tls\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" type="*v1.Secret"
Aug 04 15:07:54.067697 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:54.067625    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"telemeter-trusted-ca-bundle-8i12ta5c71j38\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" type="*v1.ConfigMap"
Aug 04 15:07:54.097903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.095163    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"]
Aug 04 15:07:54.104948 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.104903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6zkwp" event={"ID":"562f6d71-e376-49d0-9356-be4913af859c","Type":"ContainerStarted","Data":"f80369dad4d36f303960983c58fdfebd61748e878bbe3af0ed9e7edc00c9c56c"}
Aug 04 15:07:54.106326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.106275    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lchxp" event={"ID":"81f9ac9c-2479-48e8-9cff-de214c7a0566","Type":"ContainerStarted","Data":"82ea4d13573553b40a5964c9bb752c851ea6740504ced072d94572f806af20e0"}
Aug 04 15:07:54.107759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.107722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp" event={"ID":"e5a352ff-b031-4b99-bb43-ed576458b033","Type":"ContainerStarted","Data":"985bbb67310af78ebf5fb333467afdfa7923859670716296706c57460a83ce99"}
Aug 04 15:07:54.109090 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.109070    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7" event={"ID":"27b8aac7-b51f-42d4-8448-45e040840f7c","Type":"ContainerStarted","Data":"a886c14fec86c5790adf5bab6ecd7da7d4ab009409f7aac453af2a1fd99bb431"}
Aug 04 15:07:54.110591 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.110551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsrmg" event={"ID":"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a","Type":"ContainerStarted","Data":"43de1bc4db37c2379baaf88cd91dc31cd15c468eedd42d0ca5f48b674754a4e6"}
Aug 04 15:07:54.117451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.117422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"060df0eb079b7ac3d0005a3804ce23efd77c8727a6b440f18f1207126a63aba4"}
Aug 04 15:07:54.117568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.117486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"5cd944e61f37a5c22e196a80fa4bc1597b17d8bae86daf47423d39a1485eb69c"}
Aug 04 15:07:54.117568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.117532    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"44f22b075c156acac67f8f63f002f93af15ac2fcd5cbfbe361d39b85c7bc0014"}
Aug 04 15:07:54.162691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.162691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162543    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-serving-certs-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.162691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.162691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-metrics-client-ca\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.162961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162764    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.162961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qspjp\" (UniqueName: \"kubernetes.io/projected/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-kube-api-access-qspjp\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.162961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.163121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.162974    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.163121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.163041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-federate-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.163223 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.163132    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.163223 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.163162    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.164318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.164050    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.164318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.164225    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.164318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.164258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.164318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.164316    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dttw2\" (UniqueName: \"kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.265001 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.264950    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.265527 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265013    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-metrics-client-ca\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.265736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265706    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.265853 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265789    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qspjp\" (UniqueName: \"kubernetes.io/projected/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-kube-api-access-qspjp\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.265853 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265829    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.265946 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265876    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.265946 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265922    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-federate-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.266029 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.265983    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.266170 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.266145    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.266665 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.266596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.266742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.266698    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.266742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.266714    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-metrics-client-ca\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.266923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.266741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.267203 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.267076    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.267260 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.267231    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dttw2\" (UniqueName: \"kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.267328 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.267276    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.267376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.267347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-serving-certs-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.267660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.267637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.271524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.268533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.271524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.269208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.271524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.270159    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.273746 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.273721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.275898 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.275878    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qspjp\" (UniqueName: \"kubernetes.io/projected/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-kube-api-access-qspjp\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.277203 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.277179    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dttw2\" (UniqueName: \"kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2\") pod \"console-6dcb7d6d94-d9vvz\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") " pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.352503 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.352464    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:07:54.641667 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.641582    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:07:54.795365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.795266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:54.897475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.897384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:54.933410 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.933378    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Aug 04 15:07:54.942624 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.942408    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:54.951437 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.951194    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Aug 04 15:07:54.959631 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:54.959573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-serving-certs-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.004489 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.003712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:55.017954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.017744    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-x8qjj\""
Aug 04 15:07:55.112828 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.112745    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Aug 04 15:07:55.121647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.121435    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-federate-client-tls\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.122664 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.122065    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:07:55.126539 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.125602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:55.127889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.127868    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.131587 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.131567    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 15:07:55.132004 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.131985    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 15:07:55.132389 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.132372    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 15:07:55.132695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.132678    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 15:07:55.133358 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.133342    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 15:07:55.134446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.134012    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 15:07:55.134446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.134228    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 15:07:55.135444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.134701    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 15:07:55.135444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.134914    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 15:07:55.135444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.135105    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 15:07:55.135444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.135311    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dn4j38gssjf3b\""
Aug 04 15:07:55.135673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.135531    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 15:07:55.138003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.137645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"7e122af413b2bc8518357192ae9111b5bfbea62436e5a0c2e8dbec9dcb43a975"}
Aug 04 15:07:55.141687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.140066    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kqfsf\""
Aug 04 15:07:55.141687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.140598    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 15:07:55.141687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.141460    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 15:07:55.143235 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.143213    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 15:07:55.150865 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.150840    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:07:55.177307 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177257    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177335    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177534    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177636    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177675    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcfp9\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177702    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177738    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.177810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177856    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.177886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.178011    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.178052    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.178084    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.178112    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.178207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.178137    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.264860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.264617    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Aug 04 15:07:55.266388 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:55.266358    2571 secret.go:189] Couldn't get secret openshift-monitoring/telemeter-client: failed to sync secret cache: timed out waiting for the condition
Aug 04 15:07:55.266521 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:55.266445    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client podName:0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb nodeName:}" failed. No retries permitted until 2026-08-04 15:07:55.766425687 +0000 UTC m=+68.598393805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-telemeter-client" (UniqueName: "kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client") pod "telemeter-client-65fd8855b5-pwvnb" (UID: "0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb") : failed to sync secret cache: timed out waiting for the condition
Aug 04 15:07:55.266521 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:55.266358    2571 secret.go:189] Couldn't get secret openshift-monitoring/telemeter-client-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Aug 04 15:07:55.266650 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:07:55.266550    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config podName:0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb nodeName:}" failed. No retries permitted until 2026-08-04 15:07:55.766528162 +0000 UTC m=+68.598496259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-telemeter-client-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config") pod "telemeter-client-65fd8855b5-pwvnb" (UID: "0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb") : failed to sync secret cache: timed out waiting for the condition
Aug 04 15:07:55.268234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.268178    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.279735 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279705    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.279840 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcfp9\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.279840 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279793    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.279928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.279928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279867    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.279928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.279998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280094 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280041    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280094 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280087    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280114    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280272 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280270    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280463 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280359    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.280463 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.280400    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.283326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.281073    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.288537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.286822    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.288537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.287525    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.288537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.288522    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.288999 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.288914    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.290493 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.290281    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.290896    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.290955    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.291632    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.291821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.292827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.293258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.292869    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.294006 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.293982    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.294106 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.294019    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.294239 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.294219    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.294523 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.294498    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.295133 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.295112    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.295584 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.295564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.296741 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.296703    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.302947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.302922    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcfp9\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9\") pod \"prometheus-k8s-0\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.308410 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:55.308379    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddad93147_ae9e_4d28_a91b_ae65ed5176ba.slice/crio-71dc787d4834d6b09aec815cbaf4f0ba57de1df48400a7778bd560f00383a04b WatchSource:0}: Error finding container 71dc787d4834d6b09aec815cbaf4f0ba57de1df48400a7778bd560f00383a04b: Status 404 returned error can't find the container with id 71dc787d4834d6b09aec815cbaf4f0ba57de1df48400a7778bd560f00383a04b
Aug 04 15:07:55.325650 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.325622    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Aug 04 15:07:55.453820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.453515    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:07:55.504628 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.504548    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Aug 04 15:07:55.794380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.793684    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.794380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.793828    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.797551 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.797495    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.798645 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.798363    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb-secret-telemeter-client\") pod \"telemeter-client-65fd8855b5-pwvnb\" (UID: \"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb\") " pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:55.880054 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:55.879733    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"
Aug 04 15:07:56.145069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:56.144677    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcb7d6d94-d9vvz" event={"ID":"dad93147-ae9e-4d28-a91b-ae65ed5176ba","Type":"ContainerStarted","Data":"71dc787d4834d6b09aec815cbaf4f0ba57de1df48400a7778bd560f00383a04b"}
Aug 04 15:07:56.150651 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:56.150552    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"a10ef5badc0076050de22431365018109056c8cba452a2f4a9ee3259dba35083"}
Aug 04 15:07:56.256873 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:56.256580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:56.818074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:56.818026    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:07:57.037701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.037473    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:07:57.040118 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:57.040077    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod531a0449_83e7_468c_ac68_3cdd35d92fdb.slice/crio-78c0e021d50403788e26270aded88d1d0d22040ef085a106a70c13cc2c064263 WatchSource:0}: Error finding container 78c0e021d50403788e26270aded88d1d0d22040ef085a106a70c13cc2c064263: Status 404 returned error can't find the container with id 78c0e021d50403788e26270aded88d1d0d22040ef085a106a70c13cc2c064263
Aug 04 15:07:57.068435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.068342    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-65fd8855b5-pwvnb"]
Aug 04 15:07:57.075643 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:07:57.075537    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c5c49ae_88ea_43f8_8ecb_37cc6a2f6ebb.slice/crio-abe0eea89f27e767e48d7bada0a4288f2f714667ae92392198d6095e398e7cae WatchSource:0}: Error finding container abe0eea89f27e767e48d7bada0a4288f2f714667ae92392198d6095e398e7cae: Status 404 returned error can't find the container with id abe0eea89f27e767e48d7bada0a4288f2f714667ae92392198d6095e398e7cae
Aug 04 15:07:57.158159 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.158121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"}
Aug 04 15:07:57.160118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.160081    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"78c0e021d50403788e26270aded88d1d0d22040ef085a106a70c13cc2c064263"}
Aug 04 15:07:57.161987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.161959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsrmg" event={"ID":"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a","Type":"ContainerStarted","Data":"365b5897342a3fb7f09cc1cecc1f6a0a1ad0d58043465cff6b93514bd1da3245"}
Aug 04 15:07:57.164089 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.164049    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcb7d6d94-d9vvz" event={"ID":"dad93147-ae9e-4d28-a91b-ae65ed5176ba","Type":"ContainerStarted","Data":"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"}
Aug 04 15:07:57.167914 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.167891    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" event={"ID":"251c5559-fde4-408d-a22c-dad05e4fe2e9","Type":"ContainerStarted","Data":"16afa8b7383aa52b197fec3de7ac4627c077fc149065242a9c831461f7445f0f"}
Aug 04 15:07:57.168076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.168056    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:57.169749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.169729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb" event={"ID":"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb","Type":"ContainerStarted","Data":"abe0eea89f27e767e48d7bada0a4288f2f714667ae92392198d6095e398e7cae"}
Aug 04 15:07:57.189102 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.189025    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6dcb7d6d94-d9vvz" podStartSLOduration=3.189005617 podStartE2EDuration="3.189005617s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:57.188157086 +0000 UTC m=+70.020125203" watchObservedRunningTime="2026-08-04 15:07:57.189005617 +0000 UTC m=+70.020973734"
Aug 04 15:07:57.217826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:57.217771    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l" podStartSLOduration=4.134523892 podStartE2EDuration="7.217753875s" totalImagesPullingTime="3.083229983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:07:57.2162306 +0000 UTC m=+70.048198719" watchObservedRunningTime="2026-08-04 15:07:57.217753875 +0000 UTC m=+70.049722036"
Aug 04 15:07:58.177242 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:58.177204    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d" exitCode=0
Aug 04 15:07:58.177657 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:58.177303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"}
Aug 04 15:07:58.184032 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:58.184003    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fbdbc8b7-g854l"
Aug 04 15:07:59.372881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:07:59.372844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:01.195473 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.195439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"}
Aug 04 15:08:01.195891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.195536    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"}
Aug 04 15:08:01.195891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.195574    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"}
Aug 04 15:08:01.195891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.195600    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"}
Aug 04 15:08:01.195891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.195624    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerStarted","Data":"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"}
Aug 04 15:08:01.197434 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.197400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6zkwp" event={"ID":"562f6d71-e376-49d0-9356-be4913af859c","Type":"ContainerStarted","Data":"f9c388cafec92d1882634a63fac292c92f5354ed693698b608c7286dd32e659c"}
Aug 04 15:08:01.197585 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.197470    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:08:01.199521 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.199233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lchxp" event={"ID":"81f9ac9c-2479-48e8-9cff-de214c7a0566","Type":"ContainerStarted","Data":"043ba5ab67b877339816b64bb2a0493a7d237793f6b4a51aef2ba5b63e30ba44"}
Aug 04 15:08:01.201411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.201383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7" event={"ID":"27b8aac7-b51f-42d4-8448-45e040840f7c","Type":"ContainerStarted","Data":"caf37915b1ec77ba17388f03ed207eb7dd7cf177f1ddce2913da62f4e11661ba"}
Aug 04 15:08:01.201944 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.201824    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:08:01.204832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.204441    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-dsrmg" event={"ID":"6ed314ea-e70f-4be1-bf1f-62ac0cbd953a","Type":"ContainerStarted","Data":"358b364c3d149bcdb6a3b880acc2f759191b400034709d32c2705e130bb848fd"}
Aug 04 15:08:01.206916 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.206456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp" event={"ID":"e5a352ff-b031-4b99-bb43-ed576458b033","Type":"ContainerStarted","Data":"7448a04d68b28919516e02cfa8f5da7e9cbccb4d4ad83b22f1eb65fe7ec335b3"}
Aug 04 15:08:01.208639 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.208621    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7"
Aug 04 15:08:01.236557 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.236502    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=7.383943027 podStartE2EDuration="12.236482834s" totalImagesPullingTime="4.829907971s" totalInitContainerRuntime="22.631836ms" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.233930863 +0000 UTC m=+74.065898981" watchObservedRunningTime="2026-08-04 15:08:01.236482834 +0000 UTC m=+74.068450952"
Aug 04 15:08:01.260387 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.260342    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lchxp" podStartSLOduration=65.959015812 podStartE2EDuration="1m12.260326019s" totalImagesPullingTime="6.301310207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 15:06:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.259590798 +0000 UTC m=+74.091558916" watchObservedRunningTime="2026-08-04 15:08:01.260326019 +0000 UTC m=+74.092294138"
Aug 04 15:08:01.323062 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.322633    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp" podStartSLOduration=1.88918403 podStartE2EDuration="8.322615629s" totalImagesPullingTime="6.433431599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.294209658 +0000 UTC m=+74.126177775" watchObservedRunningTime="2026-08-04 15:08:01.322615629 +0000 UTC m=+74.154583748"
Aug 04 15:08:01.323730 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.323672    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6zkwp" podStartSLOduration=67.046580757 podStartE2EDuration="1m13.323658047s" totalImagesPullingTime="6.27707729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.32291904 +0000 UTC m=+74.154887158" watchObservedRunningTime="2026-08-04 15:08:01.323658047 +0000 UTC m=+74.155626174"
Aug 04 15:08:01.349823 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.349776    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-6dffbbd67-2wmv7" podStartSLOduration=1.9700031340000002 podStartE2EDuration="8.349758868s" totalImagesPullingTime="6.379755734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.347238399 +0000 UTC m=+74.179206538" watchObservedRunningTime="2026-08-04 15:08:01.349758868 +0000 UTC m=+74.181726986"
Aug 04 15:08:01.400688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.400633    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-dsrmg" podStartSLOduration=70.234442101 podStartE2EDuration="1m13.400611869s" totalImagesPullingTime="3.166169768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:06:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:01.397279231 +0000 UTC m=+74.229247348" watchObservedRunningTime="2026-08-04 15:08:01.400611869 +0000 UTC m=+74.232579986"
Aug 04 15:08:01.532349 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.532262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:01.896623 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:01.896602    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:02.008518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.008489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:02.213878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.213838    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb" event={"ID":"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb","Type":"ContainerStarted","Data":"6bbe8b99dde3d545e47c7d69ca7a89fadbd9cc332d4dd7a649dce0be31b3906e"}
Aug 04 15:08:02.214344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.213940    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb" event={"ID":"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb","Type":"ContainerStarted","Data":"0f8002634916328db3079817b2a8ec8324443a19f0a1088f2688588791271dcf"}
Aug 04 15:08:02.214344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.213973    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb" event={"ID":"0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb","Type":"ContainerStarted","Data":"9c33c948ac30f82d62618ab5ef150524e39a5f88c2aeb453607e440302b4ac0b"}
Aug 04 15:08:02.246728 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.246671    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-65fd8855b5-pwvnb" podStartSLOduration=3.611547958 podStartE2EDuration="8.246648157s" totalImagesPullingTime="4.635100199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:02.243547351 +0000 UTC m=+75.075515467" watchObservedRunningTime="2026-08-04 15:08:02.246648157 +0000 UTC m=+75.078616275"
Aug 04 15:08:02.401371 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:02.400696    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:08:03.221016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:03.220984    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"}
Aug 04 15:08:04.229599 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.229563    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"}
Aug 04 15:08:04.229972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.229628    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"}
Aug 04 15:08:04.229972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.229657    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"}
Aug 04 15:08:04.229972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.229682    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"}
Aug 04 15:08:04.229972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.229707    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerStarted","Data":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"}
Aug 04 15:08:04.267115 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.267068    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.296977855 podStartE2EDuration="9.26705164s" totalImagesPullingTime="4.949763118s" totalInitContainerRuntime="20.310667ms" isStatefulPod=false podCreationTimestamp="2026-08-04 15:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:08:04.266046748 +0000 UTC m=+77.098014867" watchObservedRunningTime="2026-08-04 15:08:04.26705164 +0000 UTC m=+77.099019756"
Aug 04 15:08:04.353274 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:04.353248    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:08:05.374525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:05.374489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:05.454711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:05.454685    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:08:05.749912 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:05.749880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:13.578196 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:13.578061    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:08:13.578196 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:13.578137    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:08:13.743807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:13.743769    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:08:13.914954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:13.914924    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:14.015989 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:14.015940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:14.438664 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:14.438630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:19.575308 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:19.575262    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-km7n5_f5109330-6309-451b-8a12-cdbc10db479a/serve-healthcheck-canary/0.log"
Aug 04 15:08:20.387897 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:20.387859    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:20.482250 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:20.482219    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:27.424015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.423962    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6dcb7d6d94-d9vvz" podUID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" containerName="console" containerID="cri-o://aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee" gracePeriod=15
Aug 04 15:08:27.672158 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.672135    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:08:27.780701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780648    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780685    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780705    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780726    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780742    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780790    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.780889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.780814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dttw2\" (UniqueName: \"kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2\") pod \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\" (UID: \"dad93147-ae9e-4d28-a91b-ae65ed5176ba\") "
Aug 04 15:08:27.781151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.781013    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config" (OuterVolumeSpecName: "console-config") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:27.781251 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.781226    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca" (OuterVolumeSpecName: "service-ca") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:27.781357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.781265    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:27.781419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.781357    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:27.783176 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.783146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2" (OuterVolumeSpecName: "kube-api-access-dttw2") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "kube-api-access-dttw2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:08:27.783312 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.783146    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:08:27.783312 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.783234    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "dad93147-ae9e-4d28-a91b-ae65ed5176ba" (UID: "dad93147-ae9e-4d28-a91b-ae65ed5176ba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:08:27.881974 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.881954    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.881974 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.881973    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dttw2\" (UniqueName: \"kubernetes.io/projected/dad93147-ae9e-4d28-a91b-ae65ed5176ba-kube-api-access-dttw2\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.882095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.881984    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.882095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.881993    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-serving-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.882095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.882000    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/dad93147-ae9e-4d28-a91b-ae65ed5176ba-console-oauth-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.882095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.882009    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-trusted-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:27.882095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:27.882018    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/dad93147-ae9e-4d28-a91b-ae65ed5176ba-oauth-serving-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:28.187391 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.187368    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:28.283524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.283498    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:28.329180 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.329155    2571 generic.go:356] "Generic (PLEG): container finished" podID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" containerID="aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee" exitCode=0
Aug 04 15:08:28.329280 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.329190    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6dcb7d6d94-d9vvz"
Aug 04 15:08:28.329280 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.329233    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcb7d6d94-d9vvz" event={"ID":"dad93147-ae9e-4d28-a91b-ae65ed5176ba","Type":"ContainerDied","Data":"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"}
Aug 04 15:08:28.329389 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.329284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6dcb7d6d94-d9vvz" event={"ID":"dad93147-ae9e-4d28-a91b-ae65ed5176ba","Type":"ContainerDied","Data":"71dc787d4834d6b09aec815cbaf4f0ba57de1df48400a7778bd560f00383a04b"}
Aug 04 15:08:28.329389 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.329321    2571 scope.go:117] "RemoveContainer" containerID="aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"
Aug 04 15:08:28.337780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.337762    2571 scope.go:117] "RemoveContainer" containerID="aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"
Aug 04 15:08:28.338049 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:08:28.338029    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee\": container with ID starting with aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee not found: ID does not exist" containerID="aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"
Aug 04 15:08:28.338117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.338062    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee"} err="failed to get container status \"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee\": rpc error: code = NotFound desc = could not find container \"aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee\": container with ID starting with aeb7a32f0aaa2e9192d27a448d6d7d89a5b8d7c6984688f279cad7fbb2a101ee not found: ID does not exist"
Aug 04 15:08:28.350995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.350963    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:28.351635 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.351613    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:08:28.353113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:28.353096    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6dcb7d6d94-d9vvz"]
Aug 04 15:08:29.727307 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:29.727262    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" path="/var/lib/kubelet/pods/dad93147-ae9e-4d28-a91b-ae65ed5176ba/volumes"
Aug 04 15:08:32.217769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:32.217734    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6zkwp"
Aug 04 15:08:33.584412 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:33.584384    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:08:33.588542 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:33.588515    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7cbb4d558c-kzmzp"
Aug 04 15:08:38.763605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:38.763541    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6d9d6444b5-jfwwk" podUID="16f1f683-e74b-4ccd-b498-51021ee71843" containerName="console" containerID="cri-o://23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8" gracePeriod=15
Aug 04 15:08:39.004998 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.004971    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:08:39.079005 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.078916    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh855\" (UniqueName: \"kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079005 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.078956    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079009    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079057    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079095    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079120    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079189    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config\") pod \"16f1f683-e74b-4ccd-b498-51021ee71843\" (UID: \"16f1f683-e74b-4ccd-b498-51021ee71843\") "
Aug 04 15:08:39.079594 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:39.079862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca" (OuterVolumeSpecName: "service-ca") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:39.080003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079980    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:39.080072 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.079987    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config" (OuterVolumeSpecName: "console-config") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:08:39.081372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.081339    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:08:39.081471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.081394    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855" (OuterVolumeSpecName: "kube-api-access-rh855") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "kube-api-access-rh855". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:08:39.081471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.081409    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "16f1f683-e74b-4ccd-b498-51021ee71843" (UID: "16f1f683-e74b-4ccd-b498-51021ee71843"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:08:39.180769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180718    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh855\" (UniqueName: \"kubernetes.io/projected/16f1f683-e74b-4ccd-b498-51021ee71843-kube-api-access-rh855\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.180769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180763    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-trusted-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.180769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180773    2571 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-oauth-serving-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.180769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180782    2571 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-oauth-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.180769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180793    2571 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/16f1f683-e74b-4ccd-b498-51021ee71843-console-serving-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.181075 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180802    2571 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.181075 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.180810    2571 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/16f1f683-e74b-4ccd-b498-51021ee71843-console-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:08:39.383051 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.383014    2571 generic.go:356] "Generic (PLEG): container finished" podID="16f1f683-e74b-4ccd-b498-51021ee71843" containerID="23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8" exitCode=0
Aug 04 15:08:39.383206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.383065    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d9d6444b5-jfwwk"
Aug 04 15:08:39.383206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.383095    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6444b5-jfwwk" event={"ID":"16f1f683-e74b-4ccd-b498-51021ee71843","Type":"ContainerDied","Data":"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"}
Aug 04 15:08:39.383206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.383145    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d9d6444b5-jfwwk" event={"ID":"16f1f683-e74b-4ccd-b498-51021ee71843","Type":"ContainerDied","Data":"fcc7087bd2596082a8567268d7993d00a7759aa59616fb2cd7f2406ac64ef786"}
Aug 04 15:08:39.383206 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.383167    2571 scope.go:117] "RemoveContainer" containerID="23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"
Aug 04 15:08:39.392031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.392012    2571 scope.go:117] "RemoveContainer" containerID="23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"
Aug 04 15:08:39.392335 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:08:39.392317    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8\": container with ID starting with 23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8 not found: ID does not exist" containerID="23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"
Aug 04 15:08:39.392406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.392342    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8"} err="failed to get container status \"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8\": rpc error: code = NotFound desc = could not find container \"23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8\": container with ID starting with 23e34d4890dab2dc7cf40c32fdbeaba9be810a74175f351b8539444e6df4fff8 not found: ID does not exist"
Aug 04 15:08:39.404988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.404959    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:08:39.411421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.411394    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d9d6444b5-jfwwk"]
Aug 04 15:08:39.723770 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:39.723698    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16f1f683-e74b-4ccd-b498-51021ee71843" path="/var/lib/kubelet/pods/16f1f683-e74b-4ccd-b498-51021ee71843/volumes"
Aug 04 15:08:42.569511 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:42.569480    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:08:55.454669 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:55.454633    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:08:55.473787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:55.473761    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:08:56.469198 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:08:56.469166    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:04.931349 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:04.931309    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:04.994610 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:04.994577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:09.231282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231250    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:09.231720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231556    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="alertmanager" containerID="cri-o://6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d" gracePeriod=120
Aug 04 15:09:09.231720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231610    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-metric" containerID="cri-o://60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10" gracePeriod=120
Aug 04 15:09:09.231720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231635    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-web" containerID="cri-o://cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8" gracePeriod=120
Aug 04 15:09:09.231883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231703    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="prom-label-proxy" containerID="cri-o://6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909" gracePeriod=120
Aug 04 15:09:09.231883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231660    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="config-reloader" containerID="cri-o://7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c" gracePeriod=120
Aug 04 15:09:09.231883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.231714    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy" containerID="cri-o://b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120" gracePeriod=120
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508136    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909" exitCode=0
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508167    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10" exitCode=0
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508173    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120" exitCode=0
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508179    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c" exitCode=0
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508184    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d" exitCode=0
Aug 04 15:09:09.508245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508207    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"}
Aug 04 15:09:09.508686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508277    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"}
Aug 04 15:09:09.508686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508322    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"}
Aug 04 15:09:09.508686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"}
Aug 04 15:09:09.508686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:09.508370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"}
Aug 04 15:09:10.463856 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.463830    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.518102 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.518067    2571 generic.go:356] "Generic (PLEG): container finished" podID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerID="cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8" exitCode=0
Aug 04 15:09:10.518237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.518106    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"}
Aug 04 15:09:10.518237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.518139    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.518237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.518215    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7","Type":"ContainerDied","Data":"4333ea67fc2b4ecd9ea3d1db977e161c97afb3ee45ae1c0b77c947a6055f4497"}
Aug 04 15:09:10.518384 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.518250    2571 scope.go:117] "RemoveContainer" containerID="6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"
Aug 04 15:09:10.525886 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.525857    2571 scope.go:117] "RemoveContainer" containerID="60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"
Aug 04 15:09:10.533217 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.533200    2571 scope.go:117] "RemoveContainer" containerID="b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"
Aug 04 15:09:10.539718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.539701    2571 scope.go:117] "RemoveContainer" containerID="cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"
Aug 04 15:09:10.547401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.547381    2571 scope.go:117] "RemoveContainer" containerID="7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"
Aug 04 15:09:10.555144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.555117    2571 scope.go:117] "RemoveContainer" containerID="6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"
Aug 04 15:09:10.561811 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.561794    2571 scope.go:117] "RemoveContainer" containerID="de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273"
Aug 04 15:09:10.561963 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.561948    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.561975    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562001    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562021    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562036    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562078    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562100    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562489 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562464    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562573 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562518    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562573 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562550    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562586    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9xtpw\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562636    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.562790 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.562708    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca\") pod \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\" (UID: \"efdc694f-08b0-41e3-9b0e-defe9c6e9ef7\") "
Aug 04 15:09:10.563352 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.563325    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:10.563465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.563327    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:10.564391 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.563996    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:09:10.564599 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.564550    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out" (OuterVolumeSpecName: "config-out") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:09:10.564910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.564883    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.565826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.565653    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume" (OuterVolumeSpecName: "config-volume") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.565826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.565783    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.566415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.566379    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw" (OuterVolumeSpecName: "kube-api-access-9xtpw") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "kube-api-access-9xtpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:09:10.566742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.566707    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.566834 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.566787    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:09:10.567528 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.567499    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.569944 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.569800    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.577865 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.577836    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config" (OuterVolumeSpecName: "web-config") pod "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" (UID: "efdc694f-08b0-41e3-9b0e-defe9c6e9ef7"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:10.583562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.583544    2571 scope.go:117] "RemoveContainer" containerID="6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"
Aug 04 15:09:10.583870 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.583838    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909\": container with ID starting with 6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909 not found: ID does not exist" containerID="6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"
Aug 04 15:09:10.583950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.583867    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909"} err="failed to get container status \"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909\": rpc error: code = NotFound desc = could not find container \"6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909\": container with ID starting with 6c10b06c506ed5b1d34c7441197b21b8a9689cfca2638f22c1d75059ef4df909 not found: ID does not exist"
Aug 04 15:09:10.583950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.583887    2571 scope.go:117] "RemoveContainer" containerID="60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"
Aug 04 15:09:10.584144 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.584122    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10\": container with ID starting with 60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10 not found: ID does not exist" containerID="60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"
Aug 04 15:09:10.584188 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584151    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10"} err="failed to get container status \"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10\": rpc error: code = NotFound desc = could not find container \"60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10\": container with ID starting with 60ebfb311b17410abf972f1fbc95e6095c9574643dae85ab213275ae843baf10 not found: ID does not exist"
Aug 04 15:09:10.584188 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584167    2571 scope.go:117] "RemoveContainer" containerID="b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"
Aug 04 15:09:10.584435 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.584419    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120\": container with ID starting with b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120 not found: ID does not exist" containerID="b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"
Aug 04 15:09:10.584496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584439    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120"} err="failed to get container status \"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120\": rpc error: code = NotFound desc = could not find container \"b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120\": container with ID starting with b10b197ccbb6f5f6ad2ff79e5c37d931375903731f09860fb722a5f984e02120 not found: ID does not exist"
Aug 04 15:09:10.584496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584452    2571 scope.go:117] "RemoveContainer" containerID="cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"
Aug 04 15:09:10.584669 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.584648    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8\": container with ID starting with cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8 not found: ID does not exist" containerID="cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"
Aug 04 15:09:10.584706 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584675    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8"} err="failed to get container status \"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8\": rpc error: code = NotFound desc = could not find container \"cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8\": container with ID starting with cb9c82b492c50ce02bfec6c1000db8983e2ff68e8a366e2ff56a4411d5c538f8 not found: ID does not exist"
Aug 04 15:09:10.584706 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584689    2571 scope.go:117] "RemoveContainer" containerID="7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"
Aug 04 15:09:10.584946 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.584931    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c\": container with ID starting with 7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c not found: ID does not exist" containerID="7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"
Aug 04 15:09:10.584992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584949    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c"} err="failed to get container status \"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c\": rpc error: code = NotFound desc = could not find container \"7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c\": container with ID starting with 7384852687f435085a4006f460ad018bd447216ac40d6267248da10dec350e7c not found: ID does not exist"
Aug 04 15:09:10.584992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.584962    2571 scope.go:117] "RemoveContainer" containerID="6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"
Aug 04 15:09:10.585179 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.585165    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d\": container with ID starting with 6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d not found: ID does not exist" containerID="6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"
Aug 04 15:09:10.585219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.585181    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d"} err="failed to get container status \"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d\": rpc error: code = NotFound desc = could not find container \"6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d\": container with ID starting with 6dd523f0b6fed58dc3f898a9f866223c6783d23432dc6dce58ab48ad1abc159d not found: ID does not exist"
Aug 04 15:09:10.585219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.585193    2571 scope.go:117] "RemoveContainer" containerID="de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273"
Aug 04 15:09:10.585477 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:10.585459    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273\": container with ID starting with de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273 not found: ID does not exist" containerID="de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273"
Aug 04 15:09:10.585518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.585481    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273"} err="failed to get container status \"de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273\": rpc error: code = NotFound desc = could not find container \"de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273\": container with ID starting with de3b72d73e6f465226f182d024ba8a4aab51d3c6d3f8d7534fb932d87ccda273 not found: ID does not exist"
Aug 04 15:09:10.664241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664217    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664239    2571 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664254    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-tls-assets\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664266    2571 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-cluster-tls-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664279    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-main-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664317    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664331    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-web-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664345    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664358    2571 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-alertmanager-main-db\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664371    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9xtpw\" (UniqueName: \"kubernetes.io/projected/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-kube-api-access-9xtpw\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664384    2571 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664398    2571 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-metrics-client-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.664411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.664411    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7-config-out\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:10.845798 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.845779    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:10.849533 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.849514    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:10.882414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882397    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:10.882704 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882692    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="config-reloader"
Aug 04 15:09:10.882745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882707    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="config-reloader"
Aug 04 15:09:10.882745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882722    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="alertmanager"
Aug 04 15:09:10.882745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882730    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="alertmanager"
Aug 04 15:09:10.882745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882741    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" containerName="console"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882747    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" containerName="console"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882754    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-web"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882759    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-web"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882765    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-metric"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882770    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-metric"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882776    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="prom-label-proxy"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882781    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="prom-label-proxy"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882788    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f1f683-e74b-4ccd-b498-51021ee71843" containerName="console"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882795    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f1f683-e74b-4ccd-b498-51021ee71843" containerName="console"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882811    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="init-config-reloader"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882817    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="init-config-reloader"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882843    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy"
Aug 04 15:09:10.882864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882849    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882917    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-metric"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882926    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882932    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="prom-label-proxy"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882938    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="16f1f683-e74b-4ccd-b498-51021ee71843" containerName="console"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882944    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="kube-rbac-proxy-web"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882953    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dad93147-ae9e-4d28-a91b-ae65ed5176ba" containerName="console"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882962    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="alertmanager"
Aug 04 15:09:10.883214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.882969    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" containerName="config-reloader"
Aug 04 15:09:10.886801 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.886785    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.890178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890159    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Aug 04 15:09:10.890178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890174    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q9lpk\""
Aug 04 15:09:10.890337 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890174    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Aug 04 15:09:10.890337 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890159    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Aug 04 15:09:10.890703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890489    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Aug 04 15:09:10.890703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890522    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Aug 04 15:09:10.890703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890561    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Aug 04 15:09:10.890703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890588    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Aug 04 15:09:10.890703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.890564    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Aug 04 15:09:10.896573 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.896555    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Aug 04 15:09:10.908786 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.908762    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:10.967103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967081    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-config-out\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967110    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967186    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967239    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-web-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967390    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvxrp\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-kube-api-access-jvxrp\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:10.967602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:10.967466    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067744 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067720    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-web-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067744 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067744    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067764    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067784    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvxrp\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-kube-api-access-jvxrp\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067804    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067997 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-config-out\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067997 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067953    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.067997 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.067985    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068038    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068134    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068148    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.068372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.068190    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.069373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.069313    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.069652 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.069622    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c2861b7-8316-445a-8309-11e1a43e8221-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.070720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.070695    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c2861b7-8316-445a-8309-11e1a43e8221-config-out\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.071452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071402    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.071555 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.071602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071588    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.071713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071689    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.071764 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071699    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.072000 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.071978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.072117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.072097    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.072617 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.072602    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c2861b7-8316-445a-8309-11e1a43e8221-web-config\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.077688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.077645    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvxrp\" (UniqueName: \"kubernetes.io/projected/2c2861b7-8316-445a-8309-11e1a43e8221-kube-api-access-jvxrp\") pod \"alertmanager-main-0\" (UID: \"2c2861b7-8316-445a-8309-11e1a43e8221\") " pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.197814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.197791    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Aug 04 15:09:11.392814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.392786    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Aug 04 15:09:11.393396 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:09:11.393361    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c2861b7_8316_445a_8309_11e1a43e8221.slice/crio-c06f636ff3906595415c62ccfde9a634b576923dcd395943824c2fb3ab159ba8 WatchSource:0}: Error finding container c06f636ff3906595415c62ccfde9a634b576923dcd395943824c2fb3ab159ba8: Status 404 returned error can't find the container with id c06f636ff3906595415c62ccfde9a634b576923dcd395943824c2fb3ab159ba8
Aug 04 15:09:11.524338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.524309    2571 generic.go:356] "Generic (PLEG): container finished" podID="2c2861b7-8316-445a-8309-11e1a43e8221" containerID="7bb93720ed88dffe63bee9739523f57aa4a06dc91e039eaf5691eb0da0ebb323" exitCode=0
Aug 04 15:09:11.524625 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.524378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerDied","Data":"7bb93720ed88dffe63bee9739523f57aa4a06dc91e039eaf5691eb0da0ebb323"}
Aug 04 15:09:11.524625 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.524443    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"c06f636ff3906595415c62ccfde9a634b576923dcd395943824c2fb3ab159ba8"}
Aug 04 15:09:11.727963 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:11.726250    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efdc694f-08b0-41e3-9b0e-defe9c6e9ef7" path="/var/lib/kubelet/pods/efdc694f-08b0-41e3-9b0e-defe9c6e9ef7/volumes"
Aug 04 15:09:12.532223 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"a2020e1926434348e47725bacb468ec33255d2b942aa585f87a59b04e08506a4"}
Aug 04 15:09:12.532569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532272    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"e62a802b20cf99664bd6fb005aa9c34797a5acc4da188ad6639537fb2ef74847"}
Aug 04 15:09:12.532569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532344    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"91c05999bf2bb3aa5347ff2dcf6a71194fdc8ce97d613d788cb45a27ddee74eb"}
Aug 04 15:09:12.532569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532384    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"7027f0b2ebb3bd55f8e6101c0cb4bf7d46f0d66fd34d9835e9b88276804a1bf5"}
Aug 04 15:09:12.532569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532421    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"19454585ed3dca30981800a00ea6a28a63fb5a0baa6a42072fd05e09016b715c"}
Aug 04 15:09:12.532569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.532456    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c2861b7-8316-445a-8309-11e1a43e8221","Type":"ContainerStarted","Data":"0506aaf9ac569133190bc64ec9e17c4c024e72c95b4487202073ecff57e3e9be"}
Aug 04 15:09:12.566730 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:12.566649    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.549520432 podStartE2EDuration="2.566633167s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.112735ms" isStatefulPod=false podCreationTimestamp="2026-08-04 15:09:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:09:12.565309038 +0000 UTC m=+145.397277155" watchObservedRunningTime="2026-08-04 15:09:12.566633167 +0000 UTC m=+145.398601283"
Aug 04 15:09:13.474096 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474062    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:13.474371 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474346    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="prometheus" containerID="cri-o://b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609" gracePeriod=600
Aug 04 15:09:13.474446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474365    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45" gracePeriod=600
Aug 04 15:09:13.474446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474419    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy" containerID="cri-o://840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233" gracePeriod=600
Aug 04 15:09:13.474557 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474454    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="config-reloader" containerID="cri-o://5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585" gracePeriod=600
Aug 04 15:09:13.474557 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474441    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="thanos-sidecar" containerID="cri-o://5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5" gracePeriod=600
Aug 04 15:09:13.474557 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.474402    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-web" containerID="cri-o://c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e" gracePeriod=600
Aug 04 15:09:13.717699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.717674    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:13.796165 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796071    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796165 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796118    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796165 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796149    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796180    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796226    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796249    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796283    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796330    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796355    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796395    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796427    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796506    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796536    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.796860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796788    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.796860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796848    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796883    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796924    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.796951    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fcfp9\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.797000    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.797030    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.797059    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle\") pod \"531a0449-83e7-468c-ac68-3cdd35d92fdb\" (UID: \"531a0449-83e7-468c-ac68-3cdd35d92fdb\") "
Aug 04 15:09:13.797460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.797389    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.798232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.797691    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.800097    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.800212    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.800466    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config" (OuterVolumeSpecName: "config") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.800967    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.801326    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.801368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.801756    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.801927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.801768    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:09:13.803027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.802958    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.803027 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803007    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out" (OuterVolumeSpecName: "config-out") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:09:13.803415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803389    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.803602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803561    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:09:13.803962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803940    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9" (OuterVolumeSpecName: "kube-api-access-fcfp9") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "kube-api-access-fcfp9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:09:13.804049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803975    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:09:13.804049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.803977    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.804496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.804472    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.805881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.805859    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.812634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.812614    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config" (OuterVolumeSpecName: "web-config") pod "531a0449-83e7-468c-ac68-3cdd35d92fdb" (UID: "531a0449-83e7-468c-ac68-3cdd35d92fdb"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:09:13.898669 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898641    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898669 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898666    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-metrics-client-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898676    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898686    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-kube-rbac-proxy\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898695    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898703    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-db\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898711    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898719    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fcfp9\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-kube-api-access-fcfp9\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898728    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898736    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-thanos-prometheus-http-client-file\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898745    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-prometheus-trusted-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898754    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898762    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898770    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-metrics-client-certs\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898778    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/531a0449-83e7-468c-ac68-3cdd35d92fdb-config-out\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898786    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/531a0449-83e7-468c-ac68-3cdd35d92fdb-tls-assets\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898794    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-web-config\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898801    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/531a0449-83e7-468c-ac68-3cdd35d92fdb-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:13.898815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:13.898811    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/531a0449-83e7-468c-ac68-3cdd35d92fdb-secret-grpc-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:09:14.545003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.544968    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45" exitCode=0
Aug 04 15:09:14.545003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.544999    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233" exitCode=0
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545012    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e" exitCode=0
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545022    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5" exitCode=0
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545031    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585" exitCode=0
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545039    2571 generic.go:356] "Generic (PLEG): container finished" podID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609" exitCode=0
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"}
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545068    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"}
Aug 04 15:09:14.545153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545147    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"}
Aug 04 15:09:14.545451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545173    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"}
Aug 04 15:09:14.545451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545192    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.545451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"}
Aug 04 15:09:14.545451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"}
Aug 04 15:09:14.545451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.545266    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"531a0449-83e7-468c-ac68-3cdd35d92fdb","Type":"ContainerDied","Data":"78c0e021d50403788e26270aded88d1d0d22040ef085a106a70c13cc2c064263"}
Aug 04 15:09:14.554003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.553978    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.561350 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.561325    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.567776 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.567761    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.571419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.571396    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:14.575969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.575515    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.577073 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.577057    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:14.582188 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.582172    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.589316 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.589283    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.596009 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.595991    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.596249 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.596229    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.596330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596256    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.596330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596273    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.596563 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.596545    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.596609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596572    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.596609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596589    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.596827 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.596810    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.596866 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596832    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.596866 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.596851    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.597048 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.597035    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.597088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597050    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.597088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597062    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.597260 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.597245    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.597318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597265    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.597318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597279    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.597539 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.597524    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.601949 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597542    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.601949 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.597917    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.602419 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:09:14.602396    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.602501 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602422    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.602501 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602440    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.602742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602722    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.602798 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602744    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.602959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602938    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.602959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.602960    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.603217 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603198    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.603268 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603218    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.603507 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603489    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.603568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603509    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.603837 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603807    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.603894 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.603845    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.604131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604113    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.604193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604132    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.604368 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604348    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.604368 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604368    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.604560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604542    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.604629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604562    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.604802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604786    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.604863 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604802    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.605015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.604988    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.605015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.605006    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.605303 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.605270    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.605364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.605302    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.605663 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.605624    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.605663 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.605651    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.606039 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606007    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.606039 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606040    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.606314 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606272    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.606314 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606306    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.606610 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606583    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.606610 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606610    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.606891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606870    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.606957 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.606893    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.607113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607096    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.607161 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607116    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.607346 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607330    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.607404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607347    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.607560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607545    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.607600 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607560    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.607638 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607611    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:14.607776 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607755    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.607833 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607777    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.607993 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607978    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy"
Aug 04 15:09:14.608043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608019    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy"
Aug 04 15:09:14.608043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608029    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-thanos"
Aug 04 15:09:14.608043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608034    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-thanos"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608043    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="init-config-reloader"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608049    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="init-config-reloader"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608056    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-web"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608062    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-web"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.607976    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608078    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="thanos-sidecar"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608088    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="thanos-sidecar"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608098    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="prometheus"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608104    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="prometheus"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608115    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="config-reloader"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608120    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="config-reloader"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608078    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608166    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-thanos"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608175    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608182    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="prometheus"
Aug 04 15:09:14.608183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608188    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="config-reloader"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608196    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="kube-rbac-proxy-web"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608201    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" containerName="thanos-sidecar"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608407    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608424    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608631    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.608752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608646    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.608960 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608889    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.608960 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.608910    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.609138 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609119    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.609180 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609140    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.609402 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609376    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.609482 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609403    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.609791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609747    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.609791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609782    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.610023 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.609995    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.610023 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610022    2571 scope.go:117] "RemoveContainer" containerID="a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"
Aug 04 15:09:14.610264 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610243    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45"} err="failed to get container status \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": rpc error: code = NotFound desc = could not find container \"a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45\": container with ID starting with a1c862d173e951a25d5f54b79b904de9bb21d32e5e636102b4389d041bff5c45 not found: ID does not exist"
Aug 04 15:09:14.610431 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610266    2571 scope.go:117] "RemoveContainer" containerID="840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"
Aug 04 15:09:14.610523 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610503    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233"} err="failed to get container status \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": rpc error: code = NotFound desc = could not find container \"840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233\": container with ID starting with 840c6002019e6e75cc9fc3b1c270184e6ee097fe79799f0568535a2c710c9233 not found: ID does not exist"
Aug 04 15:09:14.610567 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610524    2571 scope.go:117] "RemoveContainer" containerID="c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"
Aug 04 15:09:14.610758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610740    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e"} err="failed to get container status \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": rpc error: code = NotFound desc = could not find container \"c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e\": container with ID starting with c361e55a04b6d0d43385ffefc38a2821b45f135f76cc32e99ee2c4b4e1d5113e not found: ID does not exist"
Aug 04 15:09:14.610836 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610760    2571 scope.go:117] "RemoveContainer" containerID="5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"
Aug 04 15:09:14.611012 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.610990    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5"} err="failed to get container status \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": rpc error: code = NotFound desc = could not find container \"5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5\": container with ID starting with 5420f2f93e8cdc67deee284333450752806db68b12d4e07912e4a2e892e029c5 not found: ID does not exist"
Aug 04 15:09:14.611012 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611011    2571 scope.go:117] "RemoveContainer" containerID="5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"
Aug 04 15:09:14.611256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611232    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585"} err="failed to get container status \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": rpc error: code = NotFound desc = could not find container \"5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585\": container with ID starting with 5bab9f08c00b5d44f959e1d094d9ddc3e519a540e5290a6f992c5eab7a1be585 not found: ID does not exist"
Aug 04 15:09:14.611330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611259    2571 scope.go:117] "RemoveContainer" containerID="b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"
Aug 04 15:09:14.611542 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611521    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609"} err="failed to get container status \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": rpc error: code = NotFound desc = could not find container \"b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609\": container with ID starting with b406b130203b78973a2c9e12055b3c0d3b892bcdf33211238e0d8f9281098609 not found: ID does not exist"
Aug 04 15:09:14.611615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611543    2571 scope.go:117] "RemoveContainer" containerID="df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"
Aug 04 15:09:14.611742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.611727    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d"} err="failed to get container status \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": rpc error: code = NotFound desc = could not find container \"df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d\": container with ID starting with df507699ef167ddfe6ea052bcbaef1e56036a930d83cae021b56a5566bbe313d not found: ID does not exist"
Aug 04 15:09:14.612729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.612714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.615879 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.615854    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Aug 04 15:09:14.615990 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.615859    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Aug 04 15:09:14.615990 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.615928    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Aug 04 15:09:14.615990 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.615858    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Aug 04 15:09:14.616189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616036    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Aug 04 15:09:14.616189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616185    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Aug 04 15:09:14.616348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616275    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dn4j38gssjf3b\""
Aug 04 15:09:14.616625 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616610    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-kqfsf\""
Aug 04 15:09:14.616701 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616685    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Aug 04 15:09:14.616932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616915    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Aug 04 15:09:14.616975 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.616937    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Aug 04 15:09:14.617500 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.617483    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Aug 04 15:09:14.617612 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.617533    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Aug 04 15:09:14.617832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.617808    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Aug 04 15:09:14.621455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.621439    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Aug 04 15:09:14.627374 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.627358    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Aug 04 15:09:14.632133 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.632115    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:14.703622 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703594    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703628    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703658    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703700    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703730    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703784    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config-out\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703946 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6csh\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-kube-api-access-w6csh\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.703946 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703863    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703945    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.703982    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-web-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704022    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704136    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704237    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.704415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.704260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.804813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.804813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804790    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config-out\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6csh\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-kube-api-access-w6csh\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804908    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804933    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-web-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.804968    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805221 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805239    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805267    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805323    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805354    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805447    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805475    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805478    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.805553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805539    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.805629    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.806039    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806704 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.806677    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.806829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.806804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.807782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.807564    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.807782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.807671    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.807782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.807847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.807782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.807888    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-web-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.807782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.807893    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.808323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.808120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.808615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.808591    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.808831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.808798    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config-out\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.809903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.809875    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.810542 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.810515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-config\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.810642 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.810620    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.810932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.810902    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.811073 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.811043    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5302863f-cfa1-46bd-9698-b13ce0b5a63f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.811152 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.811123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.811445 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.811422    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5302863f-cfa1-46bd-9698-b13ce0b5a63f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.813685 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.813663    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6csh\" (UniqueName: \"kubernetes.io/projected/5302863f-cfa1-46bd-9698-b13ce0b5a63f-kube-api-access-w6csh\") pod \"prometheus-k8s-0\" (UID: \"5302863f-cfa1-46bd-9698-b13ce0b5a63f\") " pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:14.922429 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:14.922404    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:15.056325 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:15.056281    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Aug 04 15:09:15.058043 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:09:15.058017    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5302863f_cfa1_46bd_9698_b13ce0b5a63f.slice/crio-f8e4ddcb0955a089887546c75b2bbe516f1f54d1a7d1d3fa391c9ab096c52b0d WatchSource:0}: Error finding container f8e4ddcb0955a089887546c75b2bbe516f1f54d1a7d1d3fa391c9ab096c52b0d: Status 404 returned error can't find the container with id f8e4ddcb0955a089887546c75b2bbe516f1f54d1a7d1d3fa391c9ab096c52b0d
Aug 04 15:09:15.551995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:15.551961    2571 generic.go:356] "Generic (PLEG): container finished" podID="5302863f-cfa1-46bd-9698-b13ce0b5a63f" containerID="48d9e71d8264543d06c7c9ccb5db146f46836b774e9062e99f8d29a39639490e" exitCode=0
Aug 04 15:09:15.552103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:15.552010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerDied","Data":"48d9e71d8264543d06c7c9ccb5db146f46836b774e9062e99f8d29a39639490e"}
Aug 04 15:09:15.552103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:15.552076    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"f8e4ddcb0955a089887546c75b2bbe516f1f54d1a7d1d3fa391c9ab096c52b0d"}
Aug 04 15:09:15.730310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:15.727535    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531a0449-83e7-468c-ac68-3cdd35d92fdb" path="/var/lib/kubelet/pods/531a0449-83e7-468c-ac68-3cdd35d92fdb/volumes"
Aug 04 15:09:16.559796 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559756    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"c466c744cb156db0601aad67cd6ab7575e86c6d2968ed4c6cecc8325bd940243"}
Aug 04 15:09:16.560237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"6fe2d58a483af567d670f04c3b5a6cc3bd883a343c61152e038ca0c7ad9d5d72"}
Aug 04 15:09:16.560237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"84fd8ea21638ec70d13257353c660b317069308419ca3bb0effdb3b7f3181b83"}
Aug 04 15:09:16.560237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559909    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"aeaaa1173379f2e05c022f443a39c6737d036090a80dca5a6257967cc1080e3e"}
Aug 04 15:09:16.560237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559934    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"cdb01c5042ab633e356358dcd74de4c65519e7c7853c2b476c51b7a1cd8b0637"}
Aug 04 15:09:16.560237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.559959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5302863f-cfa1-46bd-9698-b13ce0b5a63f","Type":"ContainerStarted","Data":"367e1f7372d356fd70eff23e1266ac8d8fd5493e3ee1663a84cd723e4335abb1"}
Aug 04 15:09:16.597975 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.597925    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5807205460000002 podStartE2EDuration="2.597906676s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.18613ms" isStatefulPod=false podCreationTimestamp="2026-08-04 15:09:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:09:16.595277456 +0000 UTC m=+149.427245571" watchObservedRunningTime="2026-08-04 15:09:16.597906676 +0000 UTC m=+149.429874792"
Aug 04 15:09:16.890922 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.890894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:16.954842 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:16.954813    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:19.923150 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:19.923112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:09:20.406600 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:20.406560    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:20.506065 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:20.506029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:23.998737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:23.998701    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:24.102161 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:24.102126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:24.198925 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:24.198895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:24.956722 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:24.956695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:25.062726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:25.062700    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:35.139954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:35.139919    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:35.240526 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:35.240492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:35.308026 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:35.307998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:49.555225 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:49.555184    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:09:49.643683 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:09:49.643635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:10:14.923116 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:14.923078    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:10:14.939844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:14.939818    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:10:15.832029 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:15.832003    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Aug 04 15:10:40.204680 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:40.204646    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:10:40.945655 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:40.945623    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:10:51.688985 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:51.688943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:10:51.864759 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:10:51.864684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:14.568699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:14.568615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:15.599400 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:15.599365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:18.414649 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:18.414611    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:18.509169 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:18.509134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:20.257148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:20.257116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:20.353174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:20.353136    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:20.810480 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:20.810448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:22.126044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.126006    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:22.521782 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.521752    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:22.642372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.642342    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"]
Aug 04 15:11:22.644878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.644856    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.647313 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.647277    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-77hv5\""
Aug 04 15:11:22.648481 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.648460    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 04 15:11:22.648589 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.648497    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 04 15:11:22.655783 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.655765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:22.658211 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.658194    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"]
Aug 04 15:11:22.674286 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.674260    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.674413 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.674367    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69l68\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-kube-api-access-69l68\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.775241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.775182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.775362 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.775241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69l68\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-kube-api-access-69l68\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.793112 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.793095    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.795862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.795847    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69l68\" (UniqueName: \"kubernetes.io/projected/1b745fe0-f8ae-4afc-a228-2ca5a168f2d8-kube-api-access-69l68\") pod \"cert-manager-cainjector-559cdd8c87-wj2qn\" (UID: \"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:22.968728 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:22.968702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"
Aug 04 15:11:23.097547 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:23.097523    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn"]
Aug 04 15:11:23.100128 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:11:23.100100    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b745fe0_f8ae_4afc_a228_2ca5a168f2d8.slice/crio-e964f9102cd1983f2517963b1fae0683ee9875f4aa3622e29ec42d9a3637d20c WatchSource:0}: Error finding container e964f9102cd1983f2517963b1fae0683ee9875f4aa3622e29ec42d9a3637d20c: Status 404 returned error can't find the container with id e964f9102cd1983f2517963b1fae0683ee9875f4aa3622e29ec42d9a3637d20c
Aug 04 15:11:24.096397 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:24.096358    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn" event={"ID":"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8","Type":"ContainerStarted","Data":"e964f9102cd1983f2517963b1fae0683ee9875f4aa3622e29ec42d9a3637d20c"}
Aug 04 15:11:25.172733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:25.172665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:25.254406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:25.254361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:27.112262 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:27.112223    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn" event={"ID":"1b745fe0-f8ae-4afc-a228-2ca5a168f2d8","Type":"ContainerStarted","Data":"ac2f5f2917dcd4965f12438583cbc2357a67b803165ca3a5e98a0082b7edad2d"}
Aug 04 15:11:27.130159 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:27.130099    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wj2qn" podStartSLOduration=2.131177741 podStartE2EDuration="5.130077769s" totalImagesPullingTime="2.998900028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:11:27.12951339 +0000 UTC m=+279.961481509" watchObservedRunningTime="2026-08-04 15:11:27.130077769 +0000 UTC m=+279.962045887"
Aug 04 15:11:30.850724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:30.850693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:31.781662 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:31.781622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:31.904175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:31.904146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:34.990581 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:34.990531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:35.095487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:35.095426    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:11:36.804192 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.804162    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"]
Aug 04 15:11:36.807380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.807364    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.811189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.811170    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 04 15:11:36.811318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.811237    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-gvlsd\""
Aug 04 15:11:36.812123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.812100    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 04 15:11:36.828961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.828932    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"]
Aug 04 15:11:36.866819 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.866782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.867017 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.866937    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkfcm\" (UniqueName: \"kubernetes.io/projected/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-kube-api-access-rkfcm\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.967825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.967798    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkfcm\" (UniqueName: \"kubernetes.io/projected/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-kube-api-access-rkfcm\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.967976 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.967841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.968173 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.968157    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-tmp\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:36.979944 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:36.979920    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkfcm\" (UniqueName: \"kubernetes.io/projected/f9af9ebf-29a1-4e80-a881-5b44ff2d3c38-kube-api-access-rkfcm\") pod \"openshift-lws-operator-fd8ccff4c-swlw9\" (UID: \"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:37.121916 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:37.121850    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"
Aug 04 15:11:37.253857 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:37.253779    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9"]
Aug 04 15:11:37.256058 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:11:37.256036    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9af9ebf_29a1_4e80_a881_5b44ff2d3c38.slice/crio-b8870facc8572f447f31714041e4e851b724b97f72b64b1834e399a4bb647fa3 WatchSource:0}: Error finding container b8870facc8572f447f31714041e4e851b724b97f72b64b1834e399a4bb647fa3: Status 404 returned error can't find the container with id b8870facc8572f447f31714041e4e851b724b97f72b64b1834e399a4bb647fa3
Aug 04 15:11:38.159490 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:38.159460    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9" event={"ID":"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38","Type":"ContainerStarted","Data":"b8870facc8572f447f31714041e4e851b724b97f72b64b1834e399a4bb647fa3"}
Aug 04 15:11:47.560549 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:11:47.560519    2571 kubelet.go:1648] "Image garbage collection succeeded"
Aug 04 15:12:08.288040 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:08.287962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9" event={"ID":"f9af9ebf-29a1-4e80-a881-5b44ff2d3c38","Type":"ContainerStarted","Data":"96ce2ac41bb796717fd16d754cc785b489d7cc8a206c8fd98969e19c8ed476e6"}
Aug 04 15:12:08.315222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:08.315167    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-swlw9" podStartSLOduration=1.6611909950000001 podStartE2EDuration="32.315150194s" totalImagesPullingTime="30.653959199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:11:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:08.313902004 +0000 UTC m=+321.145870121" watchObservedRunningTime="2026-08-04 15:12:08.315150194 +0000 UTC m=+321.147118315"
Aug 04 15:12:09.099652 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:09.099616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:09.204018 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:09.203991    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:10.867184 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:10.867154    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:14.967348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:14.967312    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:15.154421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.154387    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:15.203104 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.203073    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"]
Aug 04 15:12:15.206507 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.206486    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.210177 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.210161    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Aug 04 15:12:15.210258 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.210162    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Aug 04 15:12:15.211273 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.211258    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fs4r4\""
Aug 04 15:12:15.211618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.211605    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Aug 04 15:12:15.217918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.217875    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"]
Aug 04 15:12:15.256457 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.256438    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:15.270659 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.270639    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.270752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.270682    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07b1d9a1-c990-4ce3-9f70-6f9afa039204-manager-config\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.270791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.270748    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cdr4\" (UniqueName: \"kubernetes.io/projected/07b1d9a1-c990-4ce3-9f70-6f9afa039204-kube-api-access-2cdr4\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.270791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.270785    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-metrics-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.371995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.371969    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.372095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.372010    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07b1d9a1-c990-4ce3-9f70-6f9afa039204-manager-config\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.372095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.372047    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cdr4\" (UniqueName: \"kubernetes.io/projected/07b1d9a1-c990-4ce3-9f70-6f9afa039204-kube-api-access-2cdr4\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.372095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.372070    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-metrics-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.372694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.372676    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/07b1d9a1-c990-4ce3-9f70-6f9afa039204-manager-config\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.374406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.374387    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-metrics-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.374564 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.374544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07b1d9a1-c990-4ce3-9f70-6f9afa039204-cert\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.382567 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.382548    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cdr4\" (UniqueName: \"kubernetes.io/projected/07b1d9a1-c990-4ce3-9f70-6f9afa039204-kube-api-access-2cdr4\") pod \"lws-controller-manager-598d546c6b-4rvt2\" (UID: \"07b1d9a1-c990-4ce3-9f70-6f9afa039204\") " pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.515360 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.515279    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:15.653950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.653926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"]
Aug 04 15:12:15.656066 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:12:15.656042    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b1d9a1_c990_4ce3_9f70_6f9afa039204.slice/crio-842e9f698ecb97da5dac505cbe8f29e45d6f1689ecc49ff828b41b64e5c7d81a WatchSource:0}: Error finding container 842e9f698ecb97da5dac505cbe8f29e45d6f1689ecc49ff828b41b64e5c7d81a: Status 404 returned error can't find the container with id 842e9f698ecb97da5dac505cbe8f29e45d6f1689ecc49ff828b41b64e5c7d81a
Aug 04 15:12:15.657931 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:15.657916    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:12:16.324349 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:16.324312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2" event={"ID":"07b1d9a1-c990-4ce3-9f70-6f9afa039204","Type":"ContainerStarted","Data":"842e9f698ecb97da5dac505cbe8f29e45d6f1689ecc49ff828b41b64e5c7d81a"}
Aug 04 15:12:18.334440 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:18.334400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2" event={"ID":"07b1d9a1-c990-4ce3-9f70-6f9afa039204","Type":"ContainerStarted","Data":"bdedea2746c7f2020ccb853e981e48ff83d02c46c453ca1031e91e16956c1828"}
Aug 04 15:12:18.334843 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:18.334542    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:18.354138 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:18.354085    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2" podStartSLOduration=1.6497148830000001 podStartE2EDuration="3.354070811s" totalImagesPullingTime="1.704355928s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:18.352512381 +0000 UTC m=+331.184480502" watchObservedRunningTime="2026-08-04 15:12:18.354070811 +0000 UTC m=+331.186038927"
Aug 04 15:12:25.855046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:25.855019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:25.952755 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:25.952732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:26.477238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:26.477210    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:26.906380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:26.906345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:27.020580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.020552    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:27.189785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.189699    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"]
Aug 04 15:12:27.193436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.193415    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.205591 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.205573    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 04 15:12:27.205883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.205864    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 04 15:12:27.206970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.206957    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 04 15:12:27.208653 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.208639    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2c586\""
Aug 04 15:12:27.214808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.214794    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 04 15:12:27.278081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278052    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"]
Aug 04 15:12:27.278456 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278436    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drjnv\" (UniqueName: \"kubernetes.io/projected/507dc8f5-0e73-47cd-b38a-ea4e11000cef-kube-api-access-drjnv\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.278630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278613    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.278711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.278769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278724    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.278821 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.278781    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379512    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drjnv\" (UniqueName: \"kubernetes.io/projected/507dc8f5-0e73-47cd-b38a-ea4e11000cef-kube-api-access-drjnv\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379584    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379631    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.379998 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.379977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-manifests\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.382104 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.382083    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/507dc8f5-0e73-47cd-b38a-ea4e11000cef-tmp\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.382265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.382245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-webhook-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.382332 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.382246    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/507dc8f5-0e73-47cd-b38a-ea4e11000cef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.396019 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.396000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drjnv\" (UniqueName: \"kubernetes.io/projected/507dc8f5-0e73-47cd-b38a-ea4e11000cef-kube-api-access-drjnv\") pod \"opendatahub-operator-controller-manager-764fcd8dc-drkkt\" (UID: \"507dc8f5-0e73-47cd-b38a-ea4e11000cef\") " pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.503401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.503343    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:27.547845 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.547821    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:27.635840 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.635817    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"]
Aug 04 15:12:27.638582 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:12:27.638556    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507dc8f5_0e73_47cd_b38a_ea4e11000cef.slice/crio-3b68ea2b7f5300bab70243ef62e6f9cbb62191c63eb031675bb5f9b865ef6716 WatchSource:0}: Error finding container 3b68ea2b7f5300bab70243ef62e6f9cbb62191c63eb031675bb5f9b865ef6716: Status 404 returned error can't find the container with id 3b68ea2b7f5300bab70243ef62e6f9cbb62191c63eb031675bb5f9b865ef6716
Aug 04 15:12:27.639837 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.639798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:27.723606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.723580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:27.877738 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:27.877684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:28.014144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:28.014120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:28.168404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:28.168376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:28.270436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:28.270408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:28.379653 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:28.379586    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt" event={"ID":"507dc8f5-0e73-47cd-b38a-ea4e11000cef","Type":"ContainerStarted","Data":"3b68ea2b7f5300bab70243ef62e6f9cbb62191c63eb031675bb5f9b865ef6716"}
Aug 04 15:12:29.341624 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:29.341588    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-598d546c6b-4rvt2"
Aug 04 15:12:31.397967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:31.397932    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt" event={"ID":"507dc8f5-0e73-47cd-b38a-ea4e11000cef","Type":"ContainerStarted","Data":"efd744667cf8375a3a6e943fd4051014d33562a7bf9e57328281e6eb3774400f"}
Aug 04 15:12:32.404634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:32.404598    2571 generic.go:356] "Generic (PLEG): container finished" podID="507dc8f5-0e73-47cd-b38a-ea4e11000cef" containerID="efd744667cf8375a3a6e943fd4051014d33562a7bf9e57328281e6eb3774400f" exitCode=0
Aug 04 15:12:32.405003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:32.404678    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt" event={"ID":"507dc8f5-0e73-47cd-b38a-ea4e11000cef","Type":"ContainerDied","Data":"efd744667cf8375a3a6e943fd4051014d33562a7bf9e57328281e6eb3774400f"}
Aug 04 15:12:33.411768 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:33.411733    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt" event={"ID":"507dc8f5-0e73-47cd-b38a-ea4e11000cef","Type":"ContainerStarted","Data":"88423ec2ac2ce1518b6cbc4f01b09147e02ccdc3e7009fc6eb65ba4abe178384"}
Aug 04 15:12:33.412201 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:33.411849    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:33.455043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:33.454952    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt" podStartSLOduration=1.644160082 podStartE2EDuration="6.454939152s" totalImagesPullingTime="3.763438561s" totalInitContainerRuntime="1.047340509s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:33.454752948 +0000 UTC m=+346.286721066" watchObservedRunningTime="2026-08-04 15:12:33.454939152 +0000 UTC m=+346.286907268"
Aug 04 15:12:42.709979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:42.709908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:42.849089 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:42.849051    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:43.159667 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:43.159636    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:43.277463 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:43.277441    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:44.419306 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:44.419264    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-764fcd8dc-drkkt"
Aug 04 15:12:46.845657 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:46.845616    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:47.026526 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:47.026494    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:48.063189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.062397    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:48.359835 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.359755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:48.445687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.445660    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"]
Aug 04 15:12:48.455640 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.455619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.462729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.462697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 04 15:12:48.462729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.462718    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6nb8c\""
Aug 04 15:12:48.462915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.462703    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 04 15:12:48.462915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.462702    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 04 15:12:48.464067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.464051    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 04 15:12:48.482547 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.482524    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"]
Aug 04 15:12:48.552811 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.552784    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdc4g\" (UniqueName: \"kubernetes.io/projected/512c6205-16ff-4899-9ad4-078282e7387a-kube-api-access-kdc4g\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.552941 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.552845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/512c6205-16ff-4899-9ad4-078282e7387a-tmp\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.553010 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.552947    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512c6205-16ff-4899-9ad4-078282e7387a-tls-certs\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.653783 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.653726    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512c6205-16ff-4899-9ad4-078282e7387a-tls-certs\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.653945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.653801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdc4g\" (UniqueName: \"kubernetes.io/projected/512c6205-16ff-4899-9ad4-078282e7387a-kube-api-access-kdc4g\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.653945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.653875    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/512c6205-16ff-4899-9ad4-078282e7387a-tmp\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.656050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.656028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/512c6205-16ff-4899-9ad4-078282e7387a-tmp\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.656277 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.656254    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/512c6205-16ff-4899-9ad4-078282e7387a-tls-certs\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.660950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.660922    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:48.670219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.670199    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdc4g\" (UniqueName: \"kubernetes.io/projected/512c6205-16ff-4899-9ad4-078282e7387a-kube-api-access-kdc4g\") pod \"kube-auth-proxy-7c7cf99455-lglgv\" (UID: \"512c6205-16ff-4899-9ad4-078282e7387a\") " pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.765774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.765734    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"
Aug 04 15:12:48.952986 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:12:48.952940    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512c6205_16ff_4899_9ad4_078282e7387a.slice/crio-f3009e46bdeef1ce7743dfc6ea52339749a06b1f077edb4d1a7b6fab24109f3e WatchSource:0}: Error finding container f3009e46bdeef1ce7743dfc6ea52339749a06b1f077edb4d1a7b6fab24109f3e: Status 404 returned error can't find the container with id f3009e46bdeef1ce7743dfc6ea52339749a06b1f077edb4d1a7b6fab24109f3e
Aug 04 15:12:48.953456 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:48.953436    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv"]
Aug 04 15:12:49.035455 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:49.035419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:49.492583 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:49.492549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv" event={"ID":"512c6205-16ff-4899-9ad4-078282e7387a","Type":"ContainerStarted","Data":"f3009e46bdeef1ce7743dfc6ea52339749a06b1f077edb4d1a7b6fab24109f3e"}
Aug 04 15:12:49.799848 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:49.799761    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:50.030897 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:50.030853    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:50.775204 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:50.775177    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:50.885048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:50.885019    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:52.379356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:52.379330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:52.509950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:52.509882    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv" event={"ID":"512c6205-16ff-4899-9ad4-078282e7387a","Type":"ContainerStarted","Data":"58da99148725e1cf59fe525f2195d02afc6c77f4abceb4434bd79b4bb9e42c84"}
Aug 04 15:12:52.537627 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:52.537586    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c7cf99455-lglgv" podStartSLOduration=1.26383804 podStartE2EDuration="4.537573189s" totalImagesPullingTime="3.273735149s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:12:52.536451859 +0000 UTC m=+365.368419975" watchObservedRunningTime="2026-08-04 15:12:52.537573189 +0000 UTC m=+365.369541306"
Aug 04 15:12:57.367219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:57.367175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:57.545579 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:57.545551    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:58.722336 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:58.722278    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:58.988560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:58.988481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:59.178634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:59.178603    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:59.648577 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:59.648547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:12:59.834433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:12:59.834402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:00.154951 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:00.154922    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:00.723643 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:00.723615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:01.062953 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:01.062870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:01.299168 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:01.299142    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:01.584901 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:01.584869    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:02.517881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:02.517841    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:02.609008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:02.608967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:34.572910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:34.572877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:48.624844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:48.624798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:48.722432 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:48.722405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:48.808393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:48.808365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:13:53.257602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:13:53.257559    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:17.135430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:17.135332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:17.742323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:17.742268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:18.788276 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:18.788229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:18.903807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:18.903776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:22.320415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:22.320373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:24.494123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:24.494087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:25.527496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:25.527461    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:26.783024 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:26.782991    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:27.760824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.760788    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"]
Aug 04 15:14:27.764164 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.764146    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.767396 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.767364    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 15:14:27.767751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.767732    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fmv6n\""
Aug 04 15:14:27.767803 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.767750    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 15:14:27.777137 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.777118    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"]
Aug 04 15:14:27.849128 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.849107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdk5t\" (UniqueName: \"kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.849468 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.849158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.949950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.949923    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.950053 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.949984    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdk5t\" (UniqueName: \"kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.950324 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.950283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:27.959203 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:27.959183    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdk5t\" (UniqueName: \"kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t\") pod \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:28.075774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:28.075725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:28.211839 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:28.211815    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"]
Aug 04 15:14:28.214615 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:14:28.214590    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc5c3d70_4b70_4bb4_b71b_e8de02a32c66.slice/crio-247b9381425d1b32bad5f1cbe9aa8de274e82354dec84e8df08e50ee4acac5d0 WatchSource:0}: Error finding container 247b9381425d1b32bad5f1cbe9aa8de274e82354dec84e8df08e50ee4acac5d0: Status 404 returned error can't find the container with id 247b9381425d1b32bad5f1cbe9aa8de274e82354dec84e8df08e50ee4acac5d0
Aug 04 15:14:28.307242 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:28.307210    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:28.956809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:28.956768    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p" event={"ID":"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66","Type":"ContainerStarted","Data":"247b9381425d1b32bad5f1cbe9aa8de274e82354dec84e8df08e50ee4acac5d0"}
Aug 04 15:14:28.981443 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:28.981418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:31.412973 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:31.412944    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:32.854505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:32.854474    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:32.925086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:32.925054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:34.930747 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:34.930716    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:34.986071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:34.986040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p" event={"ID":"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66","Type":"ContainerStarted","Data":"30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366"}
Aug 04 15:14:34.986249 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:34.986230    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:35.023117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:35.023071    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p" podStartSLOduration=1.616006505 podStartE2EDuration="8.023057329s" totalImagesPullingTime="6.407050824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:14:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:14:35.021939501 +0000 UTC m=+467.853907619" watchObservedRunningTime="2026-08-04 15:14:35.023057329 +0000 UTC m=+467.855025521"
Aug 04 15:14:35.042025 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:35.042003    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:37.504336 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:37.504287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:37.985861 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:37.985830    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:38.349848 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:38.349776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:38.457758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:38.457731    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:44.386947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:44.386915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:44.488607 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:44.488575    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:45.992880 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:45.992852    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:48.116706 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.116673    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"]
Aug 04 15:14:48.117163 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.116854    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" containerName="manager" containerID="cri-o://30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366" gracePeriod=2
Aug 04 15:14:48.120144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.120118    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"]
Aug 04 15:14:48.125427 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:48.125395    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:48.146691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.146669    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:14:48.147049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.147035    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" containerName="manager"
Aug 04 15:14:48.147049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.147050    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" containerName="manager"
Aug 04 15:14:48.147187 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.147119    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" containerName="manager"
Aug 04 15:14:48.150205 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.150187    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.170459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.170433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:14:48.205154 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:48.205127    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:48.210600 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.210578    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4z7g\" (UniqueName: \"kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.210691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.210629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.311845 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.311817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.311969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.311909    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4z7g\" (UniqueName: \"kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.312196 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.312173    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.321694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.321669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4z7g\" (UniqueName: \"kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bw5l4\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.350857 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.350840    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:48.353714 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:48.353688    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:48.412636 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.412616    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdk5t\" (UniqueName: \"kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t\") pod \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") "
Aug 04 15:14:48.412754 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.412664    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume\") pod \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\" (UID: \"cc5c3d70-4b70-4bb4-b71b-e8de02a32c66\") "
Aug 04 15:14:48.413020 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.412998    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" (UID: "cc5c3d70-4b70-4bb4-b71b-e8de02a32c66"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:14:48.414601 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.414576    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t" (OuterVolumeSpecName: "kube-api-access-rdk5t") pod "cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" (UID: "cc5c3d70-4b70-4bb4-b71b-e8de02a32c66"). InnerVolumeSpecName "kube-api-access-rdk5t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:14:48.500379 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.500352    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:48.513187 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.513165    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdk5t\" (UniqueName: \"kubernetes.io/projected/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-kube-api-access-rdk5t\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:14:48.513277 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.513189    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66-extensions-socket-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:14:48.641472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:48.641449    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:14:48.643632 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:14:48.643602    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6120f3_ac05_46f7_a85f_abf4027c033a.slice/crio-36db8eeaf4e881502d45fb2edef24fc29fcb7fea1ccd7ad79d1799a9d151eca9 WatchSource:0}: Error finding container 36db8eeaf4e881502d45fb2edef24fc29fcb7fea1ccd7ad79d1799a9d151eca9: Status 404 returned error can't find the container with id 36db8eeaf4e881502d45fb2edef24fc29fcb7fea1ccd7ad79d1799a9d151eca9
Aug 04 15:14:49.050310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.050221    2571 generic.go:356] "Generic (PLEG): container finished" podID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" containerID="30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366" exitCode=0
Aug 04 15:14:49.050310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.050262    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:49.050602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.050329    2571 scope.go:117] "RemoveContainer" containerID="30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366"
Aug 04 15:14:49.051967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.051943    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" event={"ID":"0d6120f3-ac05-46f7-a85f-abf4027c033a","Type":"ContainerStarted","Data":"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"}
Aug 04 15:14:49.052074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.051996    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" event={"ID":"0d6120f3-ac05-46f7-a85f-abf4027c033a","Type":"ContainerStarted","Data":"36db8eeaf4e881502d45fb2edef24fc29fcb7fea1ccd7ad79d1799a9d151eca9"}
Aug 04 15:14:49.052074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.052026    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:14:49.056238 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:49.056213    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:49.059225 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.059209    2571 scope.go:117] "RemoveContainer" containerID="30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366"
Aug 04 15:14:49.059500 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:49.059482    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366\": container with ID starting with 30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366 not found: ID does not exist" containerID="30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366"
Aug 04 15:14:49.059562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.059508    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366"} err="failed to get container status \"30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366\": rpc error: code = NotFound desc = could not find container \"30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366\": container with ID starting with 30b40ab72900e531b5ffde0a5a161988e55e285b1a44e2e2f1813bbcb223d366 not found: ID does not exist"
Aug 04 15:14:49.088117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.088078    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" podStartSLOduration=1.088066256 podStartE2EDuration="1.088066256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:14:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:14:49.085347287 +0000 UTC m=+481.917315402" watchObservedRunningTime="2026-08-04 15:14:49.088066256 +0000 UTC m=+481.920034373"
Aug 04 15:14:49.089620 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:49.089597    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:49.091770 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:14:49.091751    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-njj4p\" is forbidden: User \"system:node:ip-10-0-136-138.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-138.ec2.internal' and this object" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-njj4p"
Aug 04 15:14:49.723340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:49.723274    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cc5c3d70-4b70-4bb4-b71b-e8de02a32c66" path="/var/lib/kubelet/pods/cc5c3d70-4b70-4bb4-b71b-e8de02a32c66/volumes"
Aug 04 15:14:50.136724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:50.136694    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:50.234802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:50.234776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:50.760270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:50.760246    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:50.861927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:50.861900    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:54.148857 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:54.148824    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:54.250300 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:54.250271    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:57.754938 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:57.754901    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:14:57.846079 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:14:57.846030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:00.061466 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:00.061431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:15:05.313511 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.313471    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:15:05.313912 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.313727    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" podUID="0d6120f3-ac05-46f7-a85f-abf4027c033a" containerName="manager" containerID="cri-o://dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3" gracePeriod=10
Aug 04 15:15:05.555422 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.555402    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:15:05.587896 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.587816    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:05.648883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.648858    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume\") pod \"0d6120f3-ac05-46f7-a85f-abf4027c033a\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") "
Aug 04 15:15:05.648980 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.648898    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4z7g\" (UniqueName: \"kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g\") pod \"0d6120f3-ac05-46f7-a85f-abf4027c033a\" (UID: \"0d6120f3-ac05-46f7-a85f-abf4027c033a\") "
Aug 04 15:15:05.649226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.649203    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d6120f3-ac05-46f7-a85f-abf4027c033a" (UID: "0d6120f3-ac05-46f7-a85f-abf4027c033a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:15:05.650926 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.650909    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g" (OuterVolumeSpecName: "kube-api-access-z4z7g") pod "0d6120f3-ac05-46f7-a85f-abf4027c033a" (UID: "0d6120f3-ac05-46f7-a85f-abf4027c033a"). InnerVolumeSpecName "kube-api-access-z4z7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:15:05.680726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.680699    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:05.749602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.749583    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4z7g\" (UniqueName: \"kubernetes.io/projected/0d6120f3-ac05-46f7-a85f-abf4027c033a-kube-api-access-z4z7g\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:05.749602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:05.749604    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d6120f3-ac05-46f7-a85f-abf4027c033a-extensions-socket-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:06.135986 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.135951    2571 generic.go:356] "Generic (PLEG): container finished" podID="0d6120f3-ac05-46f7-a85f-abf4027c033a" containerID="dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3" exitCode=0
Aug 04 15:15:06.136175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.136021    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"
Aug 04 15:15:06.136175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.136046    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" event={"ID":"0d6120f3-ac05-46f7-a85f-abf4027c033a","Type":"ContainerDied","Data":"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"}
Aug 04 15:15:06.136175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.136112    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4" event={"ID":"0d6120f3-ac05-46f7-a85f-abf4027c033a","Type":"ContainerDied","Data":"36db8eeaf4e881502d45fb2edef24fc29fcb7fea1ccd7ad79d1799a9d151eca9"}
Aug 04 15:15:06.136175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.136143    2571 scope.go:117] "RemoveContainer" containerID="dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"
Aug 04 15:15:06.145061 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.145045    2571 scope.go:117] "RemoveContainer" containerID="dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"
Aug 04 15:15:06.145340 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:15:06.145316    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3\": container with ID starting with dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3 not found: ID does not exist" containerID="dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"
Aug 04 15:15:06.145414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.145347    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3"} err="failed to get container status \"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3\": rpc error: code = NotFound desc = could not find container \"dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3\": container with ID starting with dab9c9ba8de856d5e9d9eebc1afa1dcd4c92aaed6286ae772a363f97f21b2af3 not found: ID does not exist"
Aug 04 15:15:06.160200 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.160174    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:15:06.167187 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:06.167166    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bw5l4"]
Aug 04 15:15:07.723677 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:07.723630    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d6120f3-ac05-46f7-a85f-abf4027c033a" path="/var/lib/kubelet/pods/0d6120f3-ac05-46f7-a85f-abf4027c033a/volumes"
Aug 04 15:15:16.569754 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:16.569717    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:21.887924 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:21.887872    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:22.253947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:22.253875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:23.786346 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.786314    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:23.786781 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.786765    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d6120f3-ac05-46f7-a85f-abf4027c033a" containerName="manager"
Aug 04 15:15:23.786832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.786782    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d6120f3-ac05-46f7-a85f-abf4027c033a" containerName="manager"
Aug 04 15:15:23.786868 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.786846    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d6120f3-ac05-46f7-a85f-abf4027c033a" containerName="manager"
Aug 04 15:15:23.789736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.789717    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.792620 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.792597    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 04 15:15:23.792620 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.792625    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 04 15:15:23.792821 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.792758    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:23.793995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.793975    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 04 15:15:23.794116 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.793978    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g9sm8\""
Aug 04 15:15:23.800838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.800819    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:23.873936 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.873916    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:23.878097 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.878075    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:23.884575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.884552    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s78gv\" (UniqueName: \"kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.884657 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.884599    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.948054 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.948031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:23.985233 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.985207    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s78gv\" (UniqueName: \"kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.985341 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.985240    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.985824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.985807    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:23.998800 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:23.998780    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s78gv\" (UniqueName: \"kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv\") pod \"limitador-limitador-64c94fd64f-nrmqg\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:24.047747 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.047691    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:24.101406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.101384    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:24.243952 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.243929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:24.246588 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:24.246392    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc74c35_98a2_4351_b568_51e266b1bdda.slice/crio-7078c77275ba6ebd21720a5666083a813cd77bb83e37acc574159222c0fec4dc WatchSource:0}: Error finding container 7078c77275ba6ebd21720a5666083a813cd77bb83e37acc574159222c0fec4dc: Status 404 returned error can't find the container with id 7078c77275ba6ebd21720a5666083a813cd77bb83e37acc574159222c0fec4dc
Aug 04 15:15:24.614124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.614097    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:24.618525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.618502    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:24.621532 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.621515    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ktd7s\""
Aug 04 15:15:24.630911 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.630889    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:24.661770 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.661741    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:24.690874 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.690845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbb9b\" (UniqueName: \"kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b\") pod \"authorino-58cd955675-rpbgx\" (UID: \"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e\") " pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:24.765311 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.765264    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:24.791333 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.791310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbb9b\" (UniqueName: \"kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b\") pod \"authorino-58cd955675-rpbgx\" (UID: \"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e\") " pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:24.800574 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.800553    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbb9b\" (UniqueName: \"kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b\") pod \"authorino-58cd955675-rpbgx\" (UID: \"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e\") " pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:24.805148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.805122    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:15:24.808982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.808960    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:24.818679 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.818659    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:15:24.891945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.891913    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxqzk\" (UniqueName: \"kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk\") pod \"authorino-75d556bd77-lftg8\" (UID: \"e9e0f8f2-784f-4306-a177-4c8e9452fc6d\") " pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:24.927887 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.927864    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:24.993321 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:24.992874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxqzk\" (UniqueName: \"kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk\") pod \"authorino-75d556bd77-lftg8\" (UID: \"e9e0f8f2-784f-4306-a177-4c8e9452fc6d\") " pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:25.005454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.005427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxqzk\" (UniqueName: \"kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk\") pod \"authorino-75d556bd77-lftg8\" (UID: \"e9e0f8f2-784f-4306-a177-4c8e9452fc6d\") " pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:25.095170 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.095136    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:25.101528 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:25.101498    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1381bcfc_913a_4b35_be1a_af4e0bcc3e5e.slice/crio-7e058f35fd2fe4803c14b79e5e1d776447a493d33ce9041de86d46e48a40f262 WatchSource:0}: Error finding container 7e058f35fd2fe4803c14b79e5e1d776447a493d33ce9041de86d46e48a40f262: Status 404 returned error can't find the container with id 7e058f35fd2fe4803c14b79e5e1d776447a493d33ce9041de86d46e48a40f262
Aug 04 15:15:25.118262 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.118231    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:25.232937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.232866    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rpbgx" event={"ID":"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e","Type":"ContainerStarted","Data":"7e058f35fd2fe4803c14b79e5e1d776447a493d33ce9041de86d46e48a40f262"}
Aug 04 15:15:25.236229 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.236133    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" event={"ID":"4bc74c35-98a2-4351-b568-51e266b1bdda","Type":"ContainerStarted","Data":"7078c77275ba6ebd21720a5666083a813cd77bb83e37acc574159222c0fec4dc"}
Aug 04 15:15:25.283940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:25.283915    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:15:25.286107 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:25.286079    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9e0f8f2_784f_4306_a177_4c8e9452fc6d.slice/crio-6175c2c4230889e2b7b7ac0eda6554fc93abd20804a42fc36f727706a5073594 WatchSource:0}: Error finding container 6175c2c4230889e2b7b7ac0eda6554fc93abd20804a42fc36f727706a5073594: Status 404 returned error can't find the container with id 6175c2c4230889e2b7b7ac0eda6554fc93abd20804a42fc36f727706a5073594
Aug 04 15:15:26.244564 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:26.244522    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lftg8" event={"ID":"e9e0f8f2-784f-4306-a177-4c8e9452fc6d","Type":"ContainerStarted","Data":"6175c2c4230889e2b7b7ac0eda6554fc93abd20804a42fc36f727706a5073594"}
Aug 04 15:15:29.275001 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.274956    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rpbgx" event={"ID":"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e","Type":"ContainerStarted","Data":"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"}
Aug 04 15:15:29.277043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.277009    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lftg8" event={"ID":"e9e0f8f2-784f-4306-a177-4c8e9452fc6d","Type":"ContainerStarted","Data":"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"}
Aug 04 15:15:29.279102 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.279073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" event={"ID":"4bc74c35-98a2-4351-b568-51e266b1bdda","Type":"ContainerStarted","Data":"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"}
Aug 04 15:15:29.279216 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.279167    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:29.290740 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.290699    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rpbgx" podStartSLOduration=1.302508038 podStartE2EDuration="5.290687366s" totalImagesPullingTime="3.988179328s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:29.289646283 +0000 UTC m=+522.121614400" watchObservedRunningTime="2026-08-04 15:15:29.290687366 +0000 UTC m=+522.122655482"
Aug 04 15:15:29.308694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.308607    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" podStartSLOduration=1.518189386 podStartE2EDuration="6.308591499s" totalImagesPullingTime="4.790402113s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:29.306813143 +0000 UTC m=+522.138781261" watchObservedRunningTime="2026-08-04 15:15:29.308591499 +0000 UTC m=+522.140559616"
Aug 04 15:15:29.324766 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.324654    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-lftg8" podStartSLOduration=1.504261392 podStartE2EDuration="5.324639829s" totalImagesPullingTime="3.820378437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:29.323829831 +0000 UTC m=+522.155797949" watchObservedRunningTime="2026-08-04 15:15:29.324639829 +0000 UTC m=+522.156607947"
Aug 04 15:15:29.347113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:29.347088    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:31.290226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:31.290155    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rpbgx" podUID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" containerName="authorino" containerID="cri-o://fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925" gracePeriod=30
Aug 04 15:15:31.536264 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:31.536240    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:31.655726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:31.655694    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbb9b\" (UniqueName: \"kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b\") pod \"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e\" (UID: \"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e\") "
Aug 04 15:15:31.657733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:31.657709    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b" (OuterVolumeSpecName: "kube-api-access-wbb9b") pod "1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" (UID: "1381bcfc-913a-4b35-be1a-af4e0bcc3e5e"). InnerVolumeSpecName "kube-api-access-wbb9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:15:31.756626 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:31.756602    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbb9b\" (UniqueName: \"kubernetes.io/projected/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e-kube-api-access-wbb9b\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:32.297287 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.297248    2571 generic.go:356] "Generic (PLEG): container finished" podID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" containerID="fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925" exitCode=0
Aug 04 15:15:32.297771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.297315    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rpbgx"
Aug 04 15:15:32.297771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.297350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rpbgx" event={"ID":"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e","Type":"ContainerDied","Data":"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"}
Aug 04 15:15:32.297771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.297413    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rpbgx" event={"ID":"1381bcfc-913a-4b35-be1a-af4e0bcc3e5e","Type":"ContainerDied","Data":"7e058f35fd2fe4803c14b79e5e1d776447a493d33ce9041de86d46e48a40f262"}
Aug 04 15:15:32.297771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.297445    2571 scope.go:117] "RemoveContainer" containerID="fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"
Aug 04 15:15:32.307254 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.307231    2571 scope.go:117] "RemoveContainer" containerID="fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"
Aug 04 15:15:32.307589 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:15:32.307569    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925\": container with ID starting with fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925 not found: ID does not exist" containerID="fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"
Aug 04 15:15:32.307648 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.307599    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925"} err="failed to get container status \"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925\": rpc error: code = NotFound desc = could not find container \"fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925\": container with ID starting with fb0601e016d3e25104e0938a3b043ba1a372198dd3977a66d8e384db0f998925 not found: ID does not exist"
Aug 04 15:15:32.314559 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.314534    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:32.318159 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:32.318134    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rpbgx"]
Aug 04 15:15:33.724419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:33.724383    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" path="/var/lib/kubelet/pods/1381bcfc-913a-4b35-be1a-af4e0bcc3e5e/volumes"
Aug 04 15:15:39.771588 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:39.771491    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:39.772081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:39.771753    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" podUID="4bc74c35-98a2-4351-b568-51e266b1bdda" containerName="limitador" containerID="cri-o://a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9" gracePeriod=30
Aug 04 15:15:39.772441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:39.772411    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:40.312712 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.312687    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:40.339439 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.339376    2571 generic.go:356] "Generic (PLEG): container finished" podID="4bc74c35-98a2-4351-b568-51e266b1bdda" containerID="a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9" exitCode=0
Aug 04 15:15:40.339439 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.339415    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"
Aug 04 15:15:40.339605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.339463    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" event={"ID":"4bc74c35-98a2-4351-b568-51e266b1bdda","Type":"ContainerDied","Data":"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"}
Aug 04 15:15:40.339605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.339513    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nrmqg" event={"ID":"4bc74c35-98a2-4351-b568-51e266b1bdda","Type":"ContainerDied","Data":"7078c77275ba6ebd21720a5666083a813cd77bb83e37acc574159222c0fec4dc"}
Aug 04 15:15:40.339605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.339539    2571 scope.go:117] "RemoveContainer" containerID="a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"
Aug 04 15:15:40.347475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.347458    2571 scope.go:117] "RemoveContainer" containerID="a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"
Aug 04 15:15:40.347725 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:15:40.347704    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9\": container with ID starting with a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9 not found: ID does not exist" containerID="a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"
Aug 04 15:15:40.347809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.347732    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9"} err="failed to get container status \"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9\": rpc error: code = NotFound desc = could not find container \"a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9\": container with ID starting with a50eec51f09913124f68a1934dcdc7879811093d81fc240b6abd1b1921b264e9 not found: ID does not exist"
Aug 04 15:15:40.431464 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.431443    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s78gv\" (UniqueName: \"kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv\") pod \"4bc74c35-98a2-4351-b568-51e266b1bdda\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") "
Aug 04 15:15:40.431568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.431555    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file\") pod \"4bc74c35-98a2-4351-b568-51e266b1bdda\" (UID: \"4bc74c35-98a2-4351-b568-51e266b1bdda\") "
Aug 04 15:15:40.431883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.431865    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file" (OuterVolumeSpecName: "config-file") pod "4bc74c35-98a2-4351-b568-51e266b1bdda" (UID: "4bc74c35-98a2-4351-b568-51e266b1bdda"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:15:40.433257 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.433233    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv" (OuterVolumeSpecName: "kube-api-access-s78gv") pod "4bc74c35-98a2-4351-b568-51e266b1bdda" (UID: "4bc74c35-98a2-4351-b568-51e266b1bdda"). InnerVolumeSpecName "kube-api-access-s78gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:15:40.532928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.532904    2571 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4bc74c35-98a2-4351-b568-51e266b1bdda-config-file\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:40.532928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.532924    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s78gv\" (UniqueName: \"kubernetes.io/projected/4bc74c35-98a2-4351-b568-51e266b1bdda-kube-api-access-s78gv\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:40.663913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.663887    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:40.666475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:40.666455    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nrmqg"]
Aug 04 15:15:41.725065 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:41.725028    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc74c35-98a2-4351-b568-51e266b1bdda" path="/var/lib/kubelet/pods/4bc74c35-98a2-4351-b568-51e266b1bdda/volumes"
Aug 04 15:15:45.087228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.087191    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:45.184687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.184657    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:45.529955 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.529611    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"]
Aug 04 15:15:45.530147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530121    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" containerName="authorino"
Aug 04 15:15:45.530147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530139    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" containerName="authorino"
Aug 04 15:15:45.530265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530158    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc74c35-98a2-4351-b568-51e266b1bdda" containerName="limitador"
Aug 04 15:15:45.530265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530164    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc74c35-98a2-4351-b568-51e266b1bdda" containerName="limitador"
Aug 04 15:15:45.530265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530226    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1381bcfc-913a-4b35-be1a-af4e0bcc3e5e" containerName="authorino"
Aug 04 15:15:45.530265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.530234    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc74c35-98a2-4351-b568-51e266b1bdda" containerName="limitador"
Aug 04 15:15:45.533388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.533365    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.536253 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.536228    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 15:15:45.536414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.536335    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-dhl9f\""
Aug 04 15:15:45.536414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.536380    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 04 15:15:45.537411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.537390    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 04 15:15:45.541621 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.541595    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"]
Aug 04 15:15:45.561751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.561729    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:45.672409 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.672375    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-data\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.672538 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.672417    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spz2c\" (UniqueName: \"kubernetes.io/projected/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-kube-api-access-spz2c\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.773356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.773286    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-data\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.773473 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.773376    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spz2c\" (UniqueName: \"kubernetes.io/projected/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-kube-api-access-spz2c\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.773662 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.773642    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-data\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.783372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.783316    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spz2c\" (UniqueName: \"kubernetes.io/projected/c30a466a-0be1-4027-8b1e-9cf67a56cdd6-kube-api-access-spz2c\") pod \"postgres-69fb4594cf-z66cz\" (UID: \"c30a466a-0be1-4027-8b1e-9cf67a56cdd6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.846640 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.846620    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:45.974817 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:45.974793    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"]
Aug 04 15:15:45.976722 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:45.976701    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc30a466a_0be1_4027_8b1e_9cf67a56cdd6.slice/crio-f2a615b7b954c4de805092d8909dae564b630d74b49842a961b046307f33d069 WatchSource:0}: Error finding container f2a615b7b954c4de805092d8909dae564b630d74b49842a961b046307f33d069: Status 404 returned error can't find the container with id f2a615b7b954c4de805092d8909dae564b630d74b49842a961b046307f33d069
Aug 04 15:15:46.373174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:46.373140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz" event={"ID":"c30a466a-0be1-4027-8b1e-9cf67a56cdd6","Type":"ContainerStarted","Data":"f2a615b7b954c4de805092d8909dae564b630d74b49842a961b046307f33d069"}
Aug 04 15:15:50.656889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:50.656866    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Aug 04 15:15:51.400990 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:51.400955    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz" event={"ID":"c30a466a-0be1-4027-8b1e-9cf67a56cdd6","Type":"ContainerStarted","Data":"66f5ff98011acdb701ffa0a1320eedab47d4132bc73ad89906d4b5a6cdc2b1dc"}
Aug 04 15:15:51.401147 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:51.401023    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:51.419015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:51.418968    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz" podStartSLOduration=1.743008584 podStartE2EDuration="6.418953678s" totalImagesPullingTime="4.675945094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:51.417455732 +0000 UTC m=+544.249423850" watchObservedRunningTime="2026-08-04 15:15:51.418953678 +0000 UTC m=+544.250921795"
Aug 04 15:15:57.433929 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:57.433900    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-z66cz"
Aug 04 15:15:57.763056 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:57.762973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:58.000125 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.000087    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:15:58.008670 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.008642    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:58.012214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.012189    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:15:58.078557 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.078514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gjzv\" (UniqueName: \"kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv\") pod \"authorino-5d4b67c446-l9cwm\" (UID: \"1fb808a5-e560-4448-b190-2d0b52b60068\") " pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:58.179084 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.179042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gjzv\" (UniqueName: \"kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv\") pod \"authorino-5d4b67c446-l9cwm\" (UID: \"1fb808a5-e560-4448-b190-2d0b52b60068\") " pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:58.187193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.187156    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gjzv\" (UniqueName: \"kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv\") pod \"authorino-5d4b67c446-l9cwm\" (UID: \"1fb808a5-e560-4448-b190-2d0b52b60068\") " pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:58.253049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.253012    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:15:58.253325 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.253311    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:58.277384 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.277280    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:15:58.282114 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.282090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:15:58.288412 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.288381    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:15:58.380535 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.380500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnl2q\" (UniqueName: \"kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q\") pod \"authorino-5c88946864-fc5bg\" (UID: \"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84\") " pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:15:58.393639 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.393543    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:15:58.396722 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:58.396692    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fb808a5_e560_4448_b190_2d0b52b60068.slice/crio-062c71b815282d349fa53fc7b1043465eec61e3aa447b3a8dfc63668644646f6 WatchSource:0}: Error finding container 062c71b815282d349fa53fc7b1043465eec61e3aa447b3a8dfc63668644646f6: Status 404 returned error can't find the container with id 062c71b815282d349fa53fc7b1043465eec61e3aa447b3a8dfc63668644646f6
Aug 04 15:15:58.438844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.438812    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" event={"ID":"1fb808a5-e560-4448-b190-2d0b52b60068","Type":"ContainerStarted","Data":"062c71b815282d349fa53fc7b1043465eec61e3aa447b3a8dfc63668644646f6"}
Aug 04 15:15:58.481561 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.481526    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnl2q\" (UniqueName: \"kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q\") pod \"authorino-5c88946864-fc5bg\" (UID: \"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84\") " pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:15:58.491226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.491200    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnl2q\" (UniqueName: \"kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q\") pod \"authorino-5c88946864-fc5bg\" (UID: \"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84\") " pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:15:58.593951 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.593855    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:15:58.610341 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.610309    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:15:58.732448 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:58.732419    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:15:58.734594 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:15:58.734564    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0fa508c6_ca2c_45b3_8dce_fe3f77dafd84.slice/crio-2fb25cf075dd48ff2f326c4a5714ab5fa716ffba6f7ed9989733fccdde4a05f4 WatchSource:0}: Error finding container 2fb25cf075dd48ff2f326c4a5714ab5fa716ffba6f7ed9989733fccdde4a05f4: Status 404 returned error can't find the container with id 2fb25cf075dd48ff2f326c4a5714ab5fa716ffba6f7ed9989733fccdde4a05f4
Aug 04 15:15:59.444472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.444438    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88946864-fc5bg" event={"ID":"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84","Type":"ContainerStarted","Data":"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"}
Aug 04 15:15:59.444951 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.444482    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88946864-fc5bg" event={"ID":"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84","Type":"ContainerStarted","Data":"2fb25cf075dd48ff2f326c4a5714ab5fa716ffba6f7ed9989733fccdde4a05f4"}
Aug 04 15:15:59.446208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.446178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" event={"ID":"1fb808a5-e560-4448-b190-2d0b52b60068","Type":"ContainerStarted","Data":"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"}
Aug 04 15:15:59.446352 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.446211    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" podUID="1fb808a5-e560-4448-b190-2d0b52b60068" containerName="authorino" containerID="cri-o://5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b" gracePeriod=30
Aug 04 15:15:59.460872 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.460831    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c88946864-fc5bg" podStartSLOduration=1.123938587 podStartE2EDuration="1.460814258s" totalImagesPullingTime="336.875671ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:59.459180476 +0000 UTC m=+552.291148586" watchObservedRunningTime="2026-08-04 15:15:59.460814258 +0000 UTC m=+552.292782374"
Aug 04 15:15:59.475464 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.475422    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" podStartSLOduration=2.026242908 podStartE2EDuration="2.47540632s" totalImagesPullingTime="449.163412ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:15:59.473598928 +0000 UTC m=+552.305567046" watchObservedRunningTime="2026-08-04 15:15:59.47540632 +0000 UTC m=+552.307374436"
Aug 04 15:15:59.487518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.487488    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:15:59.487715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.487690    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-lftg8" podUID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" containerName="authorino" containerID="cri-o://a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce" gracePeriod=30
Aug 04 15:15:59.659554 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.659528    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:15:59.662982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.662964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.667555 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.667535    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Aug 04 15:15:59.683180 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.683159    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:15:59.691501 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.691476    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjbs5\" (UniqueName: \"kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.691616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.691529    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.743899 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.743877    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:15:59.747010 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.746993    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:15:59.792066 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.792040    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gjzv\" (UniqueName: \"kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv\") pod \"1fb808a5-e560-4448-b190-2d0b52b60068\" (UID: \"1fb808a5-e560-4448-b190-2d0b52b60068\") "
Aug 04 15:15:59.792316 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.792126    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxqzk\" (UniqueName: \"kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk\") pod \"e9e0f8f2-784f-4306-a177-4c8e9452fc6d\" (UID: \"e9e0f8f2-784f-4306-a177-4c8e9452fc6d\") "
Aug 04 15:15:59.792316 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.792309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjbs5\" (UniqueName: \"kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.792472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.792361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.794314 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.794268    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk" (OuterVolumeSpecName: "kube-api-access-sxqzk") pod "e9e0f8f2-784f-4306-a177-4c8e9452fc6d" (UID: "e9e0f8f2-784f-4306-a177-4c8e9452fc6d"). InnerVolumeSpecName "kube-api-access-sxqzk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:15:59.794420 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.794398    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv" (OuterVolumeSpecName: "kube-api-access-4gjzv") pod "1fb808a5-e560-4448-b190-2d0b52b60068" (UID: "1fb808a5-e560-4448-b190-2d0b52b60068"). InnerVolumeSpecName "kube-api-access-4gjzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:15:59.794665 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.794648    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.800609 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.800586    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjbs5\" (UniqueName: \"kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5\") pod \"authorino-5c9d656f76-rv965\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") " pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:15:59.893232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.893196    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxqzk\" (UniqueName: \"kubernetes.io/projected/e9e0f8f2-784f-4306-a177-4c8e9452fc6d-kube-api-access-sxqzk\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:59.893232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.893230    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gjzv\" (UniqueName: \"kubernetes.io/projected/1fb808a5-e560-4448-b190-2d0b52b60068-kube-api-access-4gjzv\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:15:59.971982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:15:59.971957    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:16:00.093725 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.093706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:16:00.095512 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:00.095482    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeded8a5e_ca86_48fc_969a_66bab48768b1.slice/crio-226c0835d9efe7abe03e74141f351c6380311fb2765882984f391061b3574f87 WatchSource:0}: Error finding container 226c0835d9efe7abe03e74141f351c6380311fb2765882984f391061b3574f87: Status 404 returned error can't find the container with id 226c0835d9efe7abe03e74141f351c6380311fb2765882984f391061b3574f87
Aug 04 15:16:00.452535 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.452502    2571 generic.go:356] "Generic (PLEG): container finished" podID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" containerID="a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce" exitCode=0
Aug 04 15:16:00.452903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.452544    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-lftg8"
Aug 04 15:16:00.452903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.452544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lftg8" event={"ID":"e9e0f8f2-784f-4306-a177-4c8e9452fc6d","Type":"ContainerDied","Data":"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"}
Aug 04 15:16:00.452903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.452592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-lftg8" event={"ID":"e9e0f8f2-784f-4306-a177-4c8e9452fc6d","Type":"ContainerDied","Data":"6175c2c4230889e2b7b7ac0eda6554fc93abd20804a42fc36f727706a5073594"}
Aug 04 15:16:00.452903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.452613    2571 scope.go:117] "RemoveContainer" containerID="a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"
Aug 04 15:16:00.453954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.453926    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9d656f76-rv965" event={"ID":"eded8a5e-ca86-48fc-969a-66bab48768b1","Type":"ContainerStarted","Data":"226c0835d9efe7abe03e74141f351c6380311fb2765882984f391061b3574f87"}
Aug 04 15:16:00.455452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.455429    2571 generic.go:356] "Generic (PLEG): container finished" podID="1fb808a5-e560-4448-b190-2d0b52b60068" containerID="5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b" exitCode=0
Aug 04 15:16:00.455553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.455491    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-l9cwm"
Aug 04 15:16:00.455553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.455516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" event={"ID":"1fb808a5-e560-4448-b190-2d0b52b60068","Type":"ContainerDied","Data":"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"}
Aug 04 15:16:00.455643 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.455555    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-l9cwm" event={"ID":"1fb808a5-e560-4448-b190-2d0b52b60068","Type":"ContainerDied","Data":"062c71b815282d349fa53fc7b1043465eec61e3aa447b3a8dfc63668644646f6"}
Aug 04 15:16:00.462250 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.462231    2571 scope.go:117] "RemoveContainer" containerID="a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"
Aug 04 15:16:00.462648 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:00.462628    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce\": container with ID starting with a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce not found: ID does not exist" containerID="a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"
Aug 04 15:16:00.462745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.462665    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce"} err="failed to get container status \"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce\": rpc error: code = NotFound desc = could not find container \"a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce\": container with ID starting with a9dc074c2d165f723d7691e887141aa4ea37b429e9c7846ed3666362826bafce not found: ID does not exist"
Aug 04 15:16:00.462745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.462689    2571 scope.go:117] "RemoveContainer" containerID="5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"
Aug 04 15:16:00.470182 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.470166    2571 scope.go:117] "RemoveContainer" containerID="5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"
Aug 04 15:16:00.470494 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:00.470477    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b\": container with ID starting with 5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b not found: ID does not exist" containerID="5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"
Aug 04 15:16:00.470554 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.470500    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b"} err="failed to get container status \"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b\": rpc error: code = NotFound desc = could not find container \"5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b\": container with ID starting with 5ce0216558eba493d88cf3ba99f080e47d6109c478ae8849e153dc0178d89a2b not found: ID does not exist"
Aug 04 15:16:00.475560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.475538    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:16:00.480458 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.480439    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-lftg8"]
Aug 04 15:16:00.491281 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.491261    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:16:00.497911 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:00.497893    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-l9cwm"]
Aug 04 15:16:01.471848 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.471805    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9d656f76-rv965" event={"ID":"eded8a5e-ca86-48fc-969a-66bab48768b1","Type":"ContainerStarted","Data":"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"}
Aug 04 15:16:01.489418 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.489370    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c9d656f76-rv965" podStartSLOduration=2.026935302 podStartE2EDuration="2.489355078s" totalImagesPullingTime="462.419776ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:15:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:01.489071066 +0000 UTC m=+554.321039184" watchObservedRunningTime="2026-08-04 15:16:01.489355078 +0000 UTC m=+554.321323195"
Aug 04 15:16:01.518870 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.518840    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:16:01.519055 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.519028    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c88946864-fc5bg" podUID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" containerName="authorino" containerID="cri-o://7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c" gracePeriod=30
Aug 04 15:16:01.724587 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.724521    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fb808a5-e560-4448-b190-2d0b52b60068" path="/var/lib/kubelet/pods/1fb808a5-e560-4448-b190-2d0b52b60068/volumes"
Aug 04 15:16:01.724857 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.724843    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" path="/var/lib/kubelet/pods/e9e0f8f2-784f-4306-a177-4c8e9452fc6d/volumes"
Aug 04 15:16:01.766085 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.766067    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:16:01.810111 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.810086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnl2q\" (UniqueName: \"kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q\") pod \"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84\" (UID: \"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84\") "
Aug 04 15:16:01.811940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.811912    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q" (OuterVolumeSpecName: "kube-api-access-jnl2q") pod "0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" (UID: "0fa508c6-ca2c-45b3-8dce-fe3f77dafd84"). InnerVolumeSpecName "kube-api-access-jnl2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:16:01.911595 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:01.911569    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnl2q\" (UniqueName: \"kubernetes.io/projected/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84-kube-api-access-jnl2q\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:16:02.478459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.478412    2571 generic.go:356] "Generic (PLEG): container finished" podID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" containerID="7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c" exitCode=0
Aug 04 15:16:02.478915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.478471    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c88946864-fc5bg"
Aug 04 15:16:02.478915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.478495    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88946864-fc5bg" event={"ID":"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84","Type":"ContainerDied","Data":"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"}
Aug 04 15:16:02.478915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.478539    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c88946864-fc5bg" event={"ID":"0fa508c6-ca2c-45b3-8dce-fe3f77dafd84","Type":"ContainerDied","Data":"2fb25cf075dd48ff2f326c4a5714ab5fa716ffba6f7ed9989733fccdde4a05f4"}
Aug 04 15:16:02.478915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.478575    2571 scope.go:117] "RemoveContainer" containerID="7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"
Aug 04 15:16:02.488076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.488058    2571 scope.go:117] "RemoveContainer" containerID="7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"
Aug 04 15:16:02.488427 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:02.488405    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c\": container with ID starting with 7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c not found: ID does not exist" containerID="7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"
Aug 04 15:16:02.488515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.488439    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c"} err="failed to get container status \"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c\": rpc error: code = NotFound desc = could not find container \"7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c\": container with ID starting with 7f18647f9befba4c09e77797fcfd4b65514339e5bd133bc6265cca091941cf2c not found: ID does not exist"
Aug 04 15:16:02.500564 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.500527    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:16:02.504953 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:02.504926    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c88946864-fc5bg"]
Aug 04 15:16:03.723950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:03.723911    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" path="/var/lib/kubelet/pods/0fa508c6-ca2c-45b3-8dce-fe3f77dafd84/volumes"
Aug 04 15:16:04.407547 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.407515    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:04.407982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.407956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408009    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" containerName="authorino"
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408029    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" containerName="authorino"
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408052    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fb808a5-e560-4448-b190-2d0b52b60068" containerName="authorino"
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408060    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fb808a5-e560-4448-b190-2d0b52b60068" containerName="authorino"
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408081    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" containerName="authorino"
Aug 04 15:16:04.408105 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408090    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" containerName="authorino"
Aug 04 15:16:04.408453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408211    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="1fb808a5-e560-4448-b190-2d0b52b60068" containerName="authorino"
Aug 04 15:16:04.408453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408228    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9e0f8f2-784f-4306-a177-4c8e9452fc6d" containerName="authorino"
Aug 04 15:16:04.408453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.408241    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fa508c6-ca2c-45b3-8dce-fe3f77dafd84" containerName="authorino"
Aug 04 15:16:04.412280 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.412254    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.414720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.414694    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 15:16:04.414856 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.414817    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9pmw7\""
Aug 04 15:16:04.414918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.414876    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 15:16:04.420045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.419926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:04.435630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.435592    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.435826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.435677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7wj2\" (UniqueName: \"kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.474629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.474596    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:04.536381 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.536348    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.536578 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.536416    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7wj2\" (UniqueName: \"kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.536578 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:04.536494    2571 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Aug 04 15:16:04.536578 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:04.536554    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert podName:0cd1edec-08b9-45da-8426-52e8ab8c8b2c nodeName:}" failed. No retries permitted until 2026-08-04 15:16:05.03653776 +0000 UTC m=+557.868505855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert") pod "maas-controller-669b44c7bf-f8zkt" (UID: "0cd1edec-08b9-45da-8426-52e8ab8c8b2c") : secret "maas-controller-webhook-cert" not found
Aug 04 15:16:04.536962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.536943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:04.545502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.545476    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7wj2\" (UniqueName: \"kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:04.582219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.582182    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:16:04.584698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.584680    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.596847 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.596814    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:16:04.637761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.637707    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.637952 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.637874    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qdrk\" (UniqueName: \"kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.644481 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.644445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:04.739471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.739378    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qdrk\" (UniqueName: \"kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.739471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.739424    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.741902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.741879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.748251 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.748225    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qdrk\" (UniqueName: \"kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk\") pod \"maas-controller-7f7c6d8bb5-k9m47\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") " pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:04.897222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:04.897177    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:05.039306 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.039197    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:16:05.042232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.042203    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:05.042901 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:05.042868    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f7a23f0_8dd8_4519_b271_a1cd3ecb7061.slice/crio-741c7f83a50ca9ba3e5e2c5cb7133c7e2f9e722fe13c24e87d270faabd1819bb WatchSource:0}: Error finding container 741c7f83a50ca9ba3e5e2c5cb7133c7e2f9e722fe13c24e87d270faabd1819bb: Status 404 returned error can't find the container with id 741c7f83a50ca9ba3e5e2c5cb7133c7e2f9e722fe13c24e87d270faabd1819bb
Aug 04 15:16:05.044636 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.044617    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") pod \"maas-controller-669b44c7bf-f8zkt\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") " pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:05.324765 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.324662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:05.468213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.468184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:05.470207 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:05.470171    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cd1edec_08b9_45da_8426_52e8ab8c8b2c.slice/crio-eddee8d72dea72f753967a02bde4624678d51e141bc8574c918790622c24237e WatchSource:0}: Error finding container eddee8d72dea72f753967a02bde4624678d51e141bc8574c918790622c24237e: Status 404 returned error can't find the container with id eddee8d72dea72f753967a02bde4624678d51e141bc8574c918790622c24237e
Aug 04 15:16:05.495010 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.494974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" event={"ID":"0cd1edec-08b9-45da-8426-52e8ab8c8b2c","Type":"ContainerStarted","Data":"eddee8d72dea72f753967a02bde4624678d51e141bc8574c918790622c24237e"}
Aug 04 15:16:05.496175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:05.496144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" event={"ID":"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061","Type":"ContainerStarted","Data":"741c7f83a50ca9ba3e5e2c5cb7133c7e2f9e722fe13c24e87d270faabd1819bb"}
Aug 04 15:16:07.510654 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:07.510619    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" event={"ID":"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061","Type":"ContainerStarted","Data":"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"}
Aug 04 15:16:07.511057 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:07.510703    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:07.529046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:07.528935    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" podStartSLOduration=1.2973967659999999 podStartE2EDuration="3.528913328s" totalImagesPullingTime="2.231516562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:07.528467637 +0000 UTC m=+560.360435768" watchObservedRunningTime="2026-08-04 15:16:07.528913328 +0000 UTC m=+560.360881444"
Aug 04 15:16:08.517060 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:08.517016    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" event={"ID":"0cd1edec-08b9-45da-8426-52e8ab8c8b2c","Type":"ContainerStarted","Data":"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"}
Aug 04 15:16:08.517563 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:08.517264    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:08.540962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:08.540901    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" podStartSLOduration=2.229574561 podStartE2EDuration="4.540882286s" totalImagesPullingTime="2.311307725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:08.537752475 +0000 UTC m=+561.369720598" watchObservedRunningTime="2026-08-04 15:16:08.540882286 +0000 UTC m=+561.372850403"
Aug 04 15:16:09.326775 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:09.326742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:09.386154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:09.386117    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:15.333309 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:15.333245    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:15.393166 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:15.393132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:18.519505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.519471    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:16:18.567921 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.567879    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:18.568198 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.568162    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" podUID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" containerName="manager" containerID="cri-o://247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3" gracePeriod=30
Aug 04 15:16:18.570354 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.570327    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:18.828529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.828500    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:18.971256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.971202    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h7wj2\" (UniqueName: \"kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2\") pod \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") "
Aug 04 15:16:18.971465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.971368    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") pod \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\" (UID: \"0cd1edec-08b9-45da-8426-52e8ab8c8b2c\") "
Aug 04 15:16:18.973470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.973430    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2" (OuterVolumeSpecName: "kube-api-access-h7wj2") pod "0cd1edec-08b9-45da-8426-52e8ab8c8b2c" (UID: "0cd1edec-08b9-45da-8426-52e8ab8c8b2c"). InnerVolumeSpecName "kube-api-access-h7wj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:16:18.973470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:18.973456    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0cd1edec-08b9-45da-8426-52e8ab8c8b2c" (UID: "0cd1edec-08b9-45da-8426-52e8ab8c8b2c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:16:19.072525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.072438    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h7wj2\" (UniqueName: \"kubernetes.io/projected/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-kube-api-access-h7wj2\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:16:19.072525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.072472    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0cd1edec-08b9-45da-8426-52e8ab8c8b2c-webhook-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:16:19.572340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.572308    2571 generic.go:356] "Generic (PLEG): container finished" podID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" containerID="247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3" exitCode=0
Aug 04 15:16:19.572724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.572355    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-669b44c7bf-f8zkt"
Aug 04 15:16:19.572724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.572363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" event={"ID":"0cd1edec-08b9-45da-8426-52e8ab8c8b2c","Type":"ContainerDied","Data":"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"}
Aug 04 15:16:19.572724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.572404    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-669b44c7bf-f8zkt" event={"ID":"0cd1edec-08b9-45da-8426-52e8ab8c8b2c","Type":"ContainerDied","Data":"eddee8d72dea72f753967a02bde4624678d51e141bc8574c918790622c24237e"}
Aug 04 15:16:19.572724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.572425    2571 scope.go:117] "RemoveContainer" containerID="247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"
Aug 04 15:16:19.581686 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.581671    2571 scope.go:117] "RemoveContainer" containerID="247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"
Aug 04 15:16:19.581959 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:16:19.581939    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3\": container with ID starting with 247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3 not found: ID does not exist" containerID="247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"
Aug 04 15:16:19.582005 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.581970    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3"} err="failed to get container status \"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3\": rpc error: code = NotFound desc = could not find container \"247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3\": container with ID starting with 247c21dc9c6ed8fa854a6b88d554d7c1cfdf60213de2dfe523952fae8d147ac3 not found: ID does not exist"
Aug 04 15:16:19.597037 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.597017    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:19.602126 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.602107    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-669b44c7bf-f8zkt"]
Aug 04 15:16:19.723503 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:19.723466    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" path="/var/lib/kubelet/pods/0cd1edec-08b9-45da-8426-52e8ab8c8b2c/volumes"
Aug 04 15:16:39.051423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:39.051390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:40.766340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.766303    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"]
Aug 04 15:16:40.766718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.766683    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" containerName="manager"
Aug 04 15:16:40.766718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.766695    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" containerName="manager"
Aug 04 15:16:40.766807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.766794    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cd1edec-08b9-45da-8426-52e8ab8c8b2c" containerName="manager"
Aug 04 15:16:40.792944 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.792908    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"]
Aug 04 15:16:40.793158 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.793057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.796133 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.796102    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qxjgf\""
Aug 04 15:16:40.796319 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.796101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Aug 04 15:16:40.869496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.869465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de68742-67d5-46b0-9de2-4f9a333f2870-maas-api-tls\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.869674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.869514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mxg8\" (UniqueName: \"kubernetes.io/projected/6de68742-67d5-46b0-9de2-4f9a333f2870-kube-api-access-6mxg8\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.869674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.869568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de68742-67d5-46b0-9de2-4f9a333f2870-openshift-service-ca\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.970368 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.970332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de68742-67d5-46b0-9de2-4f9a333f2870-openshift-service-ca\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.970544 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.970414    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de68742-67d5-46b0-9de2-4f9a333f2870-maas-api-tls\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.970544 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.970459    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mxg8\" (UniqueName: \"kubernetes.io/projected/6de68742-67d5-46b0-9de2-4f9a333f2870-kube-api-access-6mxg8\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.971502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.971475    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de68742-67d5-46b0-9de2-4f9a333f2870-openshift-service-ca\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.972860 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.972839    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de68742-67d5-46b0-9de2-4f9a333f2870-maas-api-tls\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:40.984100 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:40.984076    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mxg8\" (UniqueName: \"kubernetes.io/projected/6de68742-67d5-46b0-9de2-4f9a333f2870-kube-api-access-6mxg8\") pod \"maas-api-d6d98b4d7-r4mkc\" (UID: \"6de68742-67d5-46b0-9de2-4f9a333f2870\") " pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:41.106844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.106760    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:41.252496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.252464    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"]
Aug 04 15:16:41.254911 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:41.254867    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de68742_67d5_46b0_9de2_4f9a333f2870.slice/crio-12186cea3a7f2105b2efd75fd4cfb8d6cd4410507c789f8b201e43c4ebbfbfbc WatchSource:0}: Error finding container 12186cea3a7f2105b2efd75fd4cfb8d6cd4410507c789f8b201e43c4ebbfbfbc: Status 404 returned error can't find the container with id 12186cea3a7f2105b2efd75fd4cfb8d6cd4410507c789f8b201e43c4ebbfbfbc
Aug 04 15:16:41.406758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.406723    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xtrnn"]
Aug 04 15:16:41.409330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.409315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.412418 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.412396    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Aug 04 15:16:41.412918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.412900    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-9zsk9\""
Aug 04 15:16:41.419282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.419256    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xtrnn"]
Aug 04 15:16:41.469937 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.469896    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"]
Aug 04 15:16:41.472300 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.472265    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.473694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.473671    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59105d2-952f-4e49-a80d-5ced3943b6c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.473812 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.473714    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.473812 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.473772    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrnqq\" (UniqueName: \"kubernetes.io/projected/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-kube-api-access-zrnqq\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.473896 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.473814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfz8\" (UniqueName: \"kubernetes.io/projected/a59105d2-952f-4e49-a80d-5ced3943b6c1-kube-api-access-cdfz8\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.482375 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.482352    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"]
Aug 04 15:16:41.575117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575086    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59105d2-952f-4e49-a80d-5ced3943b6c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.575117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575126    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.575424 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrnqq\" (UniqueName: \"kubernetes.io/projected/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-kube-api-access-zrnqq\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.575424 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfz8\" (UniqueName: \"kubernetes.io/projected/a59105d2-952f-4e49-a80d-5ced3943b6c1-kube-api-access-cdfz8\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.575821 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575796    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a59105d2-952f-4e49-a80d-5ced3943b6c1-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.575967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.575945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.590508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.587248    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrnqq\" (UniqueName: \"kubernetes.io/projected/b294d1e7-bda0-46bd-a8d2-73adb00df0e1-kube-api-access-zrnqq\") pod \"payload-pre-processing-687dbb6cf6-m74gf\" (UID: \"b294d1e7-bda0-46bd-a8d2-73adb00df0e1\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.592410 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.592388    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfz8\" (UniqueName: \"kubernetes.io/projected/a59105d2-952f-4e49-a80d-5ced3943b6c1-kube-api-access-cdfz8\") pod \"payload-processing-5cc6cd444b-xtrnn\" (UID: \"a59105d2-952f-4e49-a80d-5ced3943b6c1\") " pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.674736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.674645    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc" event={"ID":"6de68742-67d5-46b0-9de2-4f9a333f2870","Type":"ContainerStarted","Data":"12186cea3a7f2105b2efd75fd4cfb8d6cd4410507c789f8b201e43c4ebbfbfbc"}
Aug 04 15:16:41.721742 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.721714    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:41.761843 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.761810    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:41.783951 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.783923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:41.867015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.866982    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-xtrnn"]
Aug 04 15:16:41.869846 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:41.869820    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda59105d2_952f_4e49_a80d_5ced3943b6c1.slice/crio-3da95f498e5f3de829040a58a162e9658505d1eef4047deb8914eca0e747f8a9 WatchSource:0}: Error finding container 3da95f498e5f3de829040a58a162e9658505d1eef4047deb8914eca0e747f8a9: Status 404 returned error can't find the container with id 3da95f498e5f3de829040a58a162e9658505d1eef4047deb8914eca0e747f8a9
Aug 04 15:16:41.924230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:41.924208    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"]
Aug 04 15:16:41.926605 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:16:41.926540    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb294d1e7_bda0_46bd_a8d2_73adb00df0e1.slice/crio-05ae88deff57b331e3ca58405efc666be620099a7afe83e46d95bab58fc529b6 WatchSource:0}: Error finding container 05ae88deff57b331e3ca58405efc666be620099a7afe83e46d95bab58fc529b6: Status 404 returned error can't find the container with id 05ae88deff57b331e3ca58405efc666be620099a7afe83e46d95bab58fc529b6
Aug 04 15:16:42.684997 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:42.684959    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn" event={"ID":"a59105d2-952f-4e49-a80d-5ced3943b6c1","Type":"ContainerStarted","Data":"3da95f498e5f3de829040a58a162e9658505d1eef4047deb8914eca0e747f8a9"}
Aug 04 15:16:42.687585 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:42.687544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf" event={"ID":"b294d1e7-bda0-46bd-a8d2-73adb00df0e1","Type":"ContainerStarted","Data":"05ae88deff57b331e3ca58405efc666be620099a7afe83e46d95bab58fc529b6"}
Aug 04 15:16:43.695817 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:43.695737    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc" event={"ID":"6de68742-67d5-46b0-9de2-4f9a333f2870","Type":"ContainerStarted","Data":"c86bf6f792db703fef0455753149b2864a5f06e71ea4e63a0ef61b61ce418fa1"}
Aug 04 15:16:43.696311 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:43.695885    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:43.715752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:43.715695    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc" podStartSLOduration=1.601480633 podStartE2EDuration="3.715676955s" totalImagesPullingTime="2.114196322s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:43.713705161 +0000 UTC m=+596.545673271" watchObservedRunningTime="2026-08-04 15:16:43.715676955 +0000 UTC m=+596.547645071"
Aug 04 15:16:44.702982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.702928    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn" event={"ID":"a59105d2-952f-4e49-a80d-5ced3943b6c1","Type":"ContainerStarted","Data":"31a3609006601dede74a42676fd96fe760ab27ad5da8546d6c19be32a2f19324"}
Aug 04 15:16:44.703578 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.703044    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:16:44.704470 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.704445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf" event={"ID":"b294d1e7-bda0-46bd-a8d2-73adb00df0e1","Type":"ContainerStarted","Data":"182b1b651b95215ef1a80dd35d98b0b3edbda8a881bb70b90706d84f92b4a5d3"}
Aug 04 15:16:44.704599 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.704500    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:44.724889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.724842    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn" podStartSLOduration=1.8085793300000002 podStartE2EDuration="3.724827251s" totalImagesPullingTime="1.916247921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:44.722406132 +0000 UTC m=+597.554374254" watchObservedRunningTime="2026-08-04 15:16:44.724827251 +0000 UTC m=+597.556795368"
Aug 04 15:16:44.741593 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:44.741536    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf" podStartSLOduration=1.887591078 podStartE2EDuration="3.741515375s" totalImagesPullingTime="1.853924297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:16:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:16:44.740698472 +0000 UTC m=+597.572666590" watchObservedRunningTime="2026-08-04 15:16:44.741515375 +0000 UTC m=+597.573483495"
Aug 04 15:16:49.710831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:49.710801    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d6d98b4d7-r4mkc"
Aug 04 15:16:50.751469 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:50.751425    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:50.846178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:50.846149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:16:55.712817 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:55.712789    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-m74gf"
Aug 04 15:16:55.713264 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:16:55.712858    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-xtrnn"
Aug 04 15:17:03.391275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:03.391227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:21.189450 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.189377    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"]
Aug 04 15:17:21.192067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.192049    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.196149 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.196125    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 04 15:17:21.196149 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.196147    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-l75xt\""
Aug 04 15:17:21.196364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.196249    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 04 15:17:21.196364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.196351    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 04 15:17:21.202787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.202765    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"]
Aug 04 15:17:21.336238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336214    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.336376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.336376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336264    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdgjm\" (UniqueName: \"kubernetes.io/projected/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-kube-api-access-mdgjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.336376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336319    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.336376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336342    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.336376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.336369    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437279 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437145    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437279 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437165    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdgjm\" (UniqueName: \"kubernetes.io/projected/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-kube-api-access-mdgjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437467 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437316    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437467 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437467 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437631 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437598    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437710    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.437779 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.437740    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.439448 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.439427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.440121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.440077    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.446179 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.446146    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdgjm\" (UniqueName: \"kubernetes.io/projected/fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6-kube-api-access-mdgjm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-fct42\" (UID: \"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.503249 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.503228    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:21.633318 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.633273    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"]
Aug 04 15:17:21.635482 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:17:21.635444    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7ee1fc_ff76_4c0f_9c35_a90a006bcab6.slice/crio-3e8ff00c350442d4a4d1e3ef4f5bdc1f971790f54363d108fe4d7b9fab6aaa3f WatchSource:0}: Error finding container 3e8ff00c350442d4a4d1e3ef4f5bdc1f971790f54363d108fe4d7b9fab6aaa3f: Status 404 returned error can't find the container with id 3e8ff00c350442d4a4d1e3ef4f5bdc1f971790f54363d108fe4d7b9fab6aaa3f
Aug 04 15:17:21.636687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.636670    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:17:21.889729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:21.889702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42" event={"ID":"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6","Type":"ContainerStarted","Data":"3e8ff00c350442d4a4d1e3ef4f5bdc1f971790f54363d108fe4d7b9fab6aaa3f"}
Aug 04 15:17:22.896518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:22.896488    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42" event={"ID":"fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6","Type":"ContainerStarted","Data":"70f364c2f95a3d38f3c653bf195aab6a72ff0782672392f08ce6b937d99817bf"}
Aug 04 15:17:22.918095 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:22.918052    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42" podStartSLOduration=0.799897186 podStartE2EDuration="1.918037057s" totalImagesPullingTime="1.118139871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:22.917338519 +0000 UTC m=+635.749306637" watchObservedRunningTime="2026-08-04 15:17:22.918037057 +0000 UTC m=+635.750005174"
Aug 04 15:17:23.040787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:23.040727    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:30.211002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:30.210968    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:31.504233 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:31.504187    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:31.504725 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:31.504283    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:31.516844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:31.516820    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:31.954194 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:31.954163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-fct42"
Aug 04 15:17:35.006394 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:35.006357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:36.328081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:36.328044    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:38.785389 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.785360    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"]
Aug 04 15:17:38.789126 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.789109    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.791744 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.791727    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 04 15:17:38.800736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.800713    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"]
Aug 04 15:17:38.880846 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.880814    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:17:38.881931 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.881910    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.882019 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.881962    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.882080 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.882013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.882150 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.882125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.882198 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.882164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.882198 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.882189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67qx5\" (UniqueName: \"kubernetes.io/projected/64a7bc31-f4d6-4aba-b453-c2270eb39d97-kube-api-access-67qx5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983150    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67qx5\" (UniqueName: \"kubernetes.io/projected/64a7bc31-f4d6-4aba-b453-c2270eb39d97-kube-api-access-67qx5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983235    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983310    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983614 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983571    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983673    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.983781 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.983763    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.985481 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.985462    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/64a7bc31-f4d6-4aba-b453-c2270eb39d97-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.985785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.985765    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/64a7bc31-f4d6-4aba-b453-c2270eb39d97-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:38.991702 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:38.991676    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67qx5\" (UniqueName: \"kubernetes.io/projected/64a7bc31-f4d6-4aba-b453-c2270eb39d97-kube-api-access-67qx5\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc\" (UID: \"64a7bc31-f4d6-4aba-b453-c2270eb39d97\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:39.099130 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:39.099032    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:39.235863 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:39.235835    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"]
Aug 04 15:17:39.237931 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:17:39.237891    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64a7bc31_f4d6_4aba_b453_c2270eb39d97.slice/crio-90fb24bea321cf3bebb91cd2975fdb4df0bad1dcfeca93be5ab43a522bb28357 WatchSource:0}: Error finding container 90fb24bea321cf3bebb91cd2975fdb4df0bad1dcfeca93be5ab43a522bb28357: Status 404 returned error can't find the container with id 90fb24bea321cf3bebb91cd2975fdb4df0bad1dcfeca93be5ab43a522bb28357
Aug 04 15:17:39.977124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:39.977091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc" event={"ID":"64a7bc31-f4d6-4aba-b453-c2270eb39d97","Type":"ContainerStarted","Data":"fb438dbae9e2a950bae661abac2c3a71632e4eab7f0d36d5d1f62435ec053dbf"}
Aug 04 15:17:39.977586 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:39.977148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc" event={"ID":"64a7bc31-f4d6-4aba-b453-c2270eb39d97","Type":"ContainerStarted","Data":"90fb24bea321cf3bebb91cd2975fdb4df0bad1dcfeca93be5ab43a522bb28357"}
Aug 04 15:17:39.996527 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:39.996474    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc" podStartSLOduration=1.62895338 podStartE2EDuration="1.996455342s" totalImagesPullingTime="367.501962ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:17:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:17:39.99494422 +0000 UTC m=+652.826912345" watchObservedRunningTime="2026-08-04 15:17:39.996455342 +0000 UTC m=+652.828423458"
Aug 04 15:17:49.099463 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:49.099431    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:49.099815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:49.099490    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:49.111980 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:49.111957    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:50.035981 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:50.035956    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc"
Aug 04 15:17:54.631629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:17:54.631594    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:18:01.447984 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:01.447945    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:18:57.702697 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.702656    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f6c9d69cc-98bv8"]
Aug 04 15:18:57.706504 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.706479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.726596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.726571    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6c9d69cc-98bv8"]
Aug 04 15:18:57.860904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.860877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c5cw\" (UniqueName: \"kubernetes.io/projected/14594c94-6b2b-48b5-93fd-72e90a7d703a-kube-api-access-7c5cw\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.861037 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.860914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14594c94-6b2b-48b5-93fd-72e90a7d703a-tls-cert\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.961752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.961692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c5cw\" (UniqueName: \"kubernetes.io/projected/14594c94-6b2b-48b5-93fd-72e90a7d703a-kube-api-access-7c5cw\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.961752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.961733    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14594c94-6b2b-48b5-93fd-72e90a7d703a-tls-cert\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.963883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.963866    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/14594c94-6b2b-48b5-93fd-72e90a7d703a-tls-cert\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:57.978140 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:57.978120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c5cw\" (UniqueName: \"kubernetes.io/projected/14594c94-6b2b-48b5-93fd-72e90a7d703a-kube-api-access-7c5cw\") pod \"authorino-5f6c9d69cc-98bv8\" (UID: \"14594c94-6b2b-48b5-93fd-72e90a7d703a\") " pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:58.015618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:58.015595    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6c9d69cc-98bv8"
Aug 04 15:18:58.044791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:58.044765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:18:58.141802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:58.141764    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:18:58.149187 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:58.149167    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6c9d69cc-98bv8"]
Aug 04 15:18:58.151063 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:18:58.151029    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod14594c94_6b2b_48b5_93fd_72e90a7d703a.slice/crio-7cfb336194b6acfce5b0c11b8af0864a775bc7126674aa1f8fb765d7bb03fbe6 WatchSource:0}: Error finding container 7cfb336194b6acfce5b0c11b8af0864a775bc7126674aa1f8fb765d7bb03fbe6: Status 404 returned error can't find the container with id 7cfb336194b6acfce5b0c11b8af0864a775bc7126674aa1f8fb765d7bb03fbe6
Aug 04 15:18:58.370767 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:58.370702    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6c9d69cc-98bv8" event={"ID":"14594c94-6b2b-48b5-93fd-72e90a7d703a","Type":"ContainerStarted","Data":"7cfb336194b6acfce5b0c11b8af0864a775bc7126674aa1f8fb765d7bb03fbe6"}
Aug 04 15:18:59.284419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:59.284373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:18:59.380705 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:18:59.380676    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:19:00.383982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.383923    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6c9d69cc-98bv8" event={"ID":"14594c94-6b2b-48b5-93fd-72e90a7d703a","Type":"ContainerStarted","Data":"74160f4088b06d567c9bd847677e85d371e4c024ae5faa796c18b16bdd1b6b30"}
Aug 04 15:19:00.430995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.430927    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f6c9d69cc-98bv8" podStartSLOduration=2.231528151 podStartE2EDuration="3.430905023s" totalImagesPullingTime="1.199376872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:18:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:19:00.40541957 +0000 UTC m=+733.237387689" watchObservedRunningTime="2026-08-04 15:19:00.430905023 +0000 UTC m=+733.262873135"
Aug 04 15:19:00.434615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.434588    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:19:00.434977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.434950    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c9d656f76-rv965" podUID="eded8a5e-ca86-48fc-969a-66bab48768b1" containerName="authorino" containerID="cri-o://c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f" gracePeriod=30
Aug 04 15:19:00.688560 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.688537    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:19:00.791071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.791039    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjbs5\" (UniqueName: \"kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5\") pod \"eded8a5e-ca86-48fc-969a-66bab48768b1\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") "
Aug 04 15:19:00.791234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.791101    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert\") pod \"eded8a5e-ca86-48fc-969a-66bab48768b1\" (UID: \"eded8a5e-ca86-48fc-969a-66bab48768b1\") "
Aug 04 15:19:00.793190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.793161    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5" (OuterVolumeSpecName: "kube-api-access-zjbs5") pod "eded8a5e-ca86-48fc-969a-66bab48768b1" (UID: "eded8a5e-ca86-48fc-969a-66bab48768b1"). InnerVolumeSpecName "kube-api-access-zjbs5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:19:00.801457 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.801427    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "eded8a5e-ca86-48fc-969a-66bab48768b1" (UID: "eded8a5e-ca86-48fc-969a-66bab48768b1"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:19:00.892522 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.892485    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjbs5\" (UniqueName: \"kubernetes.io/projected/eded8a5e-ca86-48fc-969a-66bab48768b1-kube-api-access-zjbs5\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:19:00.892522 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:00.892514    2571 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eded8a5e-ca86-48fc-969a-66bab48768b1-tls-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:19:01.390048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.390007    2571 generic.go:356] "Generic (PLEG): container finished" podID="eded8a5e-ca86-48fc-969a-66bab48768b1" containerID="c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f" exitCode=0
Aug 04 15:19:01.390048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.390052    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9d656f76-rv965"
Aug 04 15:19:01.390572 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.390090    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9d656f76-rv965" event={"ID":"eded8a5e-ca86-48fc-969a-66bab48768b1","Type":"ContainerDied","Data":"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"}
Aug 04 15:19:01.390572 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.390134    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9d656f76-rv965" event={"ID":"eded8a5e-ca86-48fc-969a-66bab48768b1","Type":"ContainerDied","Data":"226c0835d9efe7abe03e74141f351c6380311fb2765882984f391061b3574f87"}
Aug 04 15:19:01.390572 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.390155    2571 scope.go:117] "RemoveContainer" containerID="c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"
Aug 04 15:19:01.399172 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.399118    2571 scope.go:117] "RemoveContainer" containerID="c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"
Aug 04 15:19:01.399398 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:19:01.399378    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f\": container with ID starting with c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f not found: ID does not exist" containerID="c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"
Aug 04 15:19:01.399478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.399405    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f"} err="failed to get container status \"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f\": rpc error: code = NotFound desc = could not find container \"c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f\": container with ID starting with c6fc1868370f005d73c60c69f250d4f69300ce7008ae6cc0004fcc0ed4d1815f not found: ID does not exist"
Aug 04 15:19:01.419815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.419779    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:19:01.427766 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.427740    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c9d656f76-rv965"]
Aug 04 15:19:01.724335 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:01.724250    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eded8a5e-ca86-48fc-969a-66bab48768b1" path="/var/lib/kubelet/pods/eded8a5e-ca86-48fc-969a-66bab48768b1/volumes"
Aug 04 15:19:42.525657 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:42.525624    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:19:42.626280 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:42.626238    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:19:46.758684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:46.758651    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:19:46.759082 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:46.758877    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" podUID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" containerName="manager" containerID="cri-o://e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506" gracePeriod=30
Aug 04 15:19:47.009804 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.009743    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:19:47.080208 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.080178    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert\") pod \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") "
Aug 04 15:19:47.080372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.080238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qdrk\" (UniqueName: \"kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk\") pod \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\" (UID: \"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061\") "
Aug 04 15:19:47.082192 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.082167    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk" (OuterVolumeSpecName: "kube-api-access-8qdrk") pod "9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" (UID: "9f7a23f0-8dd8-4519-b271-a1cd3ecb7061"). InnerVolumeSpecName "kube-api-access-8qdrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:19:47.082325 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.082184    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" (UID: "9f7a23f0-8dd8-4519-b271-a1cd3ecb7061"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:19:47.181585 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.181565    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-webhook-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:19:47.181585 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.181587    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qdrk\" (UniqueName: \"kubernetes.io/projected/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061-kube-api-access-8qdrk\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:19:47.476647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.476612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:19:47.638460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.638427    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" containerID="e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506" exitCode=0
Aug 04 15:19:47.638629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.638473    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47"
Aug 04 15:19:47.638629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.638495    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" event={"ID":"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061","Type":"ContainerDied","Data":"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"}
Aug 04 15:19:47.638629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.638554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-k9m47" event={"ID":"9f7a23f0-8dd8-4519-b271-a1cd3ecb7061","Type":"ContainerDied","Data":"741c7f83a50ca9ba3e5e2c5cb7133c7e2f9e722fe13c24e87d270faabd1819bb"}
Aug 04 15:19:47.638629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.638575    2571 scope.go:117] "RemoveContainer" containerID="e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"
Aug 04 15:19:47.649642 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.649624    2571 scope.go:117] "RemoveContainer" containerID="e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"
Aug 04 15:19:47.649907 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:19:47.649888    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506\": container with ID starting with e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506 not found: ID does not exist" containerID="e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"
Aug 04 15:19:47.649959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.649915    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506"} err="failed to get container status \"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506\": rpc error: code = NotFound desc = could not find container \"e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506\": container with ID starting with e3731128a9c96827aa7d178d9dcb9315c3518f440992b297aa7d7c0c74438506 not found: ID does not exist"
Aug 04 15:19:47.662399 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.662379    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:19:47.666465 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.666446    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-k9m47"]
Aug 04 15:19:47.723189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.723169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:19:47.723483 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:19:47.723462    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" path="/var/lib/kubelet/pods/9f7a23f0-8dd8-4519-b271-a1cd3ecb7061/volumes"
Aug 04 15:20:31.930571 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:31.930478    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:20:48.504965 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.504933    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:20:48.505365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505347    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" containerName="manager"
Aug 04 15:20:48.505365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505359    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" containerName="manager"
Aug 04 15:20:48.505365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505367    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eded8a5e-ca86-48fc-969a-66bab48768b1" containerName="authorino"
Aug 04 15:20:48.505471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505373    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="eded8a5e-ca86-48fc-969a-66bab48768b1" containerName="authorino"
Aug 04 15:20:48.505471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505448    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="eded8a5e-ca86-48fc-969a-66bab48768b1" containerName="authorino"
Aug 04 15:20:48.505471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.505457    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f7a23f0-8dd8-4519-b271-a1cd3ecb7061" containerName="manager"
Aug 04 15:20:48.508584 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.508564    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.512749 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.512720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9pmw7\""
Aug 04 15:20:48.512879 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.512777    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 15:20:48.512879 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.512777    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 15:20:48.527549 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.527529    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:20:48.571837 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.571813    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsljt\" (UniqueName: \"kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.571939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.571850    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.673178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.673152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsljt\" (UniqueName: \"kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.673287 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.673185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.675555 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.675537    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.683034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.683013    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsljt\" (UniqueName: \"kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt\") pod \"maas-controller-7f7c6d8bb5-g5bmm\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") " pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.819430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.819378    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:48.948082 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:48.948060    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:20:48.950313 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:20:48.950267    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd56ba9_ca01_45cf_a53a_20094fc97d9b.slice/crio-7adfff6c3bda35c9eb3d98ffe96d9301e5f4e62fab6fbc8b70c963b89e317252 WatchSource:0}: Error finding container 7adfff6c3bda35c9eb3d98ffe96d9301e5f4e62fab6fbc8b70c963b89e317252: Status 404 returned error can't find the container with id 7adfff6c3bda35c9eb3d98ffe96d9301e5f4e62fab6fbc8b70c963b89e317252
Aug 04 15:20:49.945348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:49.945318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" event={"ID":"6fd56ba9-ca01-45cf-a53a-20094fc97d9b","Type":"ContainerStarted","Data":"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"}
Aug 04 15:20:49.945761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:49.945375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" event={"ID":"6fd56ba9-ca01-45cf-a53a-20094fc97d9b","Type":"ContainerStarted","Data":"7adfff6c3bda35c9eb3d98ffe96d9301e5f4e62fab6fbc8b70c963b89e317252"}
Aug 04 15:20:49.945761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:49.945439    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:20:49.966699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:20:49.966656    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" podStartSLOduration=1.389100752 podStartE2EDuration="1.966642116s" totalImagesPullingTime="577.541364ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:20:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:20:49.965972461 +0000 UTC m=+842.797940578" watchObservedRunningTime="2026-08-04 15:20:49.966642116 +0000 UTC m=+842.798610234"
Aug 04 15:21:00.952826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:00.952798    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:21:01.234643 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:01.234569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:21:05.543415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:05.543378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:21:05.660086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:05.660052    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:21:05.660278 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:05.660240    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" podUID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" containerName="manager" containerID="cri-o://0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d" gracePeriod=30
Aug 04 15:21:05.911072 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:05.911043    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:21:06.027275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.027241    2571 generic.go:356] "Generic (PLEG): container finished" podID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" containerID="0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d" exitCode=0
Aug 04 15:21:06.027275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.027302    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm"
Aug 04 15:21:06.027275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.027284    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" event={"ID":"6fd56ba9-ca01-45cf-a53a-20094fc97d9b","Type":"ContainerDied","Data":"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"}
Aug 04 15:21:06.027580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.027355    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-g5bmm" event={"ID":"6fd56ba9-ca01-45cf-a53a-20094fc97d9b","Type":"ContainerDied","Data":"7adfff6c3bda35c9eb3d98ffe96d9301e5f4e62fab6fbc8b70c963b89e317252"}
Aug 04 15:21:06.027580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.027377    2571 scope.go:117] "RemoveContainer" containerID="0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"
Aug 04 15:21:06.030720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.030695    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert\") pod \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") "
Aug 04 15:21:06.030839 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.030732    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsljt\" (UniqueName: \"kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt\") pod \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\" (UID: \"6fd56ba9-ca01-45cf-a53a-20094fc97d9b\") "
Aug 04 15:21:06.032697 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.032669    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6fd56ba9-ca01-45cf-a53a-20094fc97d9b" (UID: "6fd56ba9-ca01-45cf-a53a-20094fc97d9b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:21:06.032956 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.032935    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt" (OuterVolumeSpecName: "kube-api-access-tsljt") pod "6fd56ba9-ca01-45cf-a53a-20094fc97d9b" (UID: "6fd56ba9-ca01-45cf-a53a-20094fc97d9b"). InnerVolumeSpecName "kube-api-access-tsljt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:21:06.037087 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.037066    2571 scope.go:117] "RemoveContainer" containerID="0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"
Aug 04 15:21:06.037436 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:21:06.037417    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d\": container with ID starting with 0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d not found: ID does not exist" containerID="0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"
Aug 04 15:21:06.037500 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.037445    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d"} err="failed to get container status \"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d\": rpc error: code = NotFound desc = could not find container \"0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d\": container with ID starting with 0fd4b92ff2f57c933ef2db2ed4e8131ca4d98a551000886424b09778fe00348d not found: ID does not exist"
Aug 04 15:21:06.131723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.131691    2571 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-webhook-cert\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:21:06.131723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.131721    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsljt\" (UniqueName: \"kubernetes.io/projected/6fd56ba9-ca01-45cf-a53a-20094fc97d9b-kube-api-access-tsljt\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:21:06.355761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.355725    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:21:06.360965 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:06.360932    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-g5bmm"]
Aug 04 15:21:07.147832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.147795    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:21:07.300068 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.300016    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-84hrl"]
Aug 04 15:21:07.300565 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.300546    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" containerName="manager"
Aug 04 15:21:07.300618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.300567    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" containerName="manager"
Aug 04 15:21:07.300689 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.300677    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" containerName="manager"
Aug 04 15:21:07.304119 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.304092    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.308357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.308319    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Aug 04 15:21:07.308357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.308319    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9pmw7\""
Aug 04 15:21:07.308661 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.308319    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Aug 04 15:21:07.312592 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.312544    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-84hrl"]
Aug 04 15:21:07.445929 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.445833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bt5t\" (UniqueName: \"kubernetes.io/projected/01fc436d-cc54-45b3-910c-66c0dbb6f826-kube-api-access-2bt5t\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.446091 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.445938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01fc436d-cc54-45b3-910c-66c0dbb6f826-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.547369 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.547326    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01fc436d-cc54-45b3-910c-66c0dbb6f826-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.547595 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.547438    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bt5t\" (UniqueName: \"kubernetes.io/projected/01fc436d-cc54-45b3-910c-66c0dbb6f826-kube-api-access-2bt5t\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.550143 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.550112    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/01fc436d-cc54-45b3-910c-66c0dbb6f826-webhook-cert\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.557344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.557283    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bt5t\" (UniqueName: \"kubernetes.io/projected/01fc436d-cc54-45b3-910c-66c0dbb6f826-kube-api-access-2bt5t\") pod \"maas-controller-7f7c6d8bb5-84hrl\" (UID: \"01fc436d-cc54-45b3-910c-66c0dbb6f826\") " pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.619385 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.619330    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:07.726398 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.726340    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd56ba9-ca01-45cf-a53a-20094fc97d9b" path="/var/lib/kubelet/pods/6fd56ba9-ca01-45cf-a53a-20094fc97d9b/volumes"
Aug 04 15:21:07.762601 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:07.762570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f7c6d8bb5-84hrl"]
Aug 04 15:21:07.764350 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:21:07.764320    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01fc436d_cc54_45b3_910c_66c0dbb6f826.slice/crio-799b0c8b32d3aef4594988d6e2421d2565226bb7ad95e1efeba03fc1de5791df WatchSource:0}: Error finding container 799b0c8b32d3aef4594988d6e2421d2565226bb7ad95e1efeba03fc1de5791df: Status 404 returned error can't find the container with id 799b0c8b32d3aef4594988d6e2421d2565226bb7ad95e1efeba03fc1de5791df
Aug 04 15:21:08.039750 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:08.039664    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl" event={"ID":"01fc436d-cc54-45b3-910c-66c0dbb6f826","Type":"ContainerStarted","Data":"799b0c8b32d3aef4594988d6e2421d2565226bb7ad95e1efeba03fc1de5791df"}
Aug 04 15:21:09.045910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:09.045871    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl" event={"ID":"01fc436d-cc54-45b3-910c-66c0dbb6f826","Type":"ContainerStarted","Data":"308d505be89515041ca5406e28457b2c574a5cc529ede79ea5e124d9b2cd063a"}
Aug 04 15:21:09.046414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:09.046002    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:21:09.065781 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:09.065716    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl" podStartSLOduration=1.7383715899999999 podStartE2EDuration="2.0656954s" totalImagesPullingTime="327.32381ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:21:09.063938405 +0000 UTC m=+861.895906524" watchObservedRunningTime="2026-08-04 15:21:09.0656954 +0000 UTC m=+861.897663587"
Aug 04 15:21:20.054150 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:21:20.054109    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f7c6d8bb5-84hrl"
Aug 04 15:22:10.206016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:10.205962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:11.545463 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:11.545425    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:16.649452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:16.649413    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:16.764729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:16.764695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:16.850049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:16.850021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:17.289185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:17.289151    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:23.090834 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:23.090794    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:22:23.160758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:22:23.160721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:23:28.360013 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:23:28.359910    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:24.508841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.508802    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bf98869d5-kzjq5"]
Aug 04 15:28:24.512275 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.512256    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.515069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.515044    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 04 15:28:24.516212 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516188    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 04 15:28:24.516354 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516208    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 04 15:28:24.516574 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516524    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 04 15:28:24.516713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516615    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-txzf8\""
Aug 04 15:28:24.516713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516653    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 04 15:28:24.516713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516570    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 04 15:28:24.516895 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.516553    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 04 15:28:24.521824 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.521801    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 04 15:28:24.535424 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.535399    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf98869d5-kzjq5"]
Aug 04 15:28:24.603177 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.603152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:24.615152 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615126    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-oauth-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615252 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615171    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-oauth-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615337 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615255    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-trusted-ca-bundle\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615337 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615327    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-console-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615418 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615365    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615418 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9frm\" (UniqueName: \"kubernetes.io/projected/bded8191-4a60-45bb-a780-4fceed852089-kube-api-access-t9frm\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.615492 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.615424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-service-ca\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716466 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716445    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-oauth-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716549 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-oauth-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716549 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-trusted-ca-bundle\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-console-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716600    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716739 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9frm\" (UniqueName: \"kubernetes.io/projected/bded8191-4a60-45bb-a780-4fceed852089-kube-api-access-t9frm\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.716739 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.716678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-service-ca\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.717271 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.717245    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-console-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.717388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.717272    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-oauth-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.717440 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.717386    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-service-ca\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.717616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.717596    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bded8191-4a60-45bb-a780-4fceed852089-trusted-ca-bundle\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.718933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.718903    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-oauth-config\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.719127 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.719110    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bded8191-4a60-45bb-a780-4fceed852089-console-serving-cert\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.725543 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.725524    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9frm\" (UniqueName: \"kubernetes.io/projected/bded8191-4a60-45bb-a780-4fceed852089-kube-api-access-t9frm\") pod \"console-5bf98869d5-kzjq5\" (UID: \"bded8191-4a60-45bb-a780-4fceed852089\") " pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.823627 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.823577    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:24.955708 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:24.955685    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bf98869d5-kzjq5"]
Aug 04 15:28:24.957400 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:28:24.957371    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbded8191_4a60_45bb_a780_4fceed852089.slice/crio-7a7a71e3df0cb50cbd3c7c4d0cc921488714a0b077e69207b6a98c96e28e5b0b WatchSource:0}: Error finding container 7a7a71e3df0cb50cbd3c7c4d0cc921488714a0b077e69207b6a98c96e28e5b0b: Status 404 returned error can't find the container with id 7a7a71e3df0cb50cbd3c7c4d0cc921488714a0b077e69207b6a98c96e28e5b0b
Aug 04 15:28:25.240736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:25.240704    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf98869d5-kzjq5" event={"ID":"bded8191-4a60-45bb-a780-4fceed852089","Type":"ContainerStarted","Data":"8d12bfd4c816a4f967f117316524b5ad6d0cb8102a3707f3146f19cc148387e6"}
Aug 04 15:28:25.240891 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:25.240790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bf98869d5-kzjq5" event={"ID":"bded8191-4a60-45bb-a780-4fceed852089","Type":"ContainerStarted","Data":"7a7a71e3df0cb50cbd3c7c4d0cc921488714a0b077e69207b6a98c96e28e5b0b"}
Aug 04 15:28:25.264310 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:25.264235    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bf98869d5-kzjq5" podStartSLOduration=1.26421808 podStartE2EDuration="1.26421808s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:28:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:28:25.262680442 +0000 UTC m=+1298.094648577" watchObservedRunningTime="2026-08-04 15:28:25.26421808 +0000 UTC m=+1298.096186261"
Aug 04 15:28:26.307794 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:26.307739    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:34.823862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:34.823775    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:34.823862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:34.823835    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:34.828848 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:34.828825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:35.298219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:35.298188    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bf98869d5-kzjq5"
Aug 04 15:28:35.457919 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:35.457886    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:35.557390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:35.557316    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:35.657550 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:35.657520    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:35.738332 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:35.738303    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:42.185037 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:42.185003    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:43.849932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:43.849887    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:28:44.821014 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:28:44.820971    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:30:00.153271 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.153238    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"]
Aug 04 15:30:00.157076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.157056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"
Aug 04 15:30:00.160040 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.160019    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-jxxg2\""
Aug 04 15:30:00.167037 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.167006    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"]
Aug 04 15:30:00.168279 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.168255    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"
Aug 04 15:30:00.307524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.307495    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"]
Aug 04 15:30:00.309669 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:30:00.309640    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d1b624c_719b_491e_a3e4_951d8109930e.slice/crio-51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82 WatchSource:0}: Error finding container 51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82: Status 404 returned error can't find the container with id 51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82
Aug 04 15:30:00.311739 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.311719    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:30:00.745615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:00.745580    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm" event={"ID":"6d1b624c-719b-491e-a3e4-951d8109930e","Type":"ContainerStarted","Data":"51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82"}
Aug 04 15:30:03.765081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:03.765050    2571 generic.go:356] "Generic (PLEG): container finished" podID="6d1b624c-719b-491e-a3e4-951d8109930e" containerID="091f5829c0382613e9017cdb57f6815327b87ada2a6199637c11d542fcd88580" exitCode=0
Aug 04 15:30:03.765423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:03.765140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm" event={"ID":"6d1b624c-719b-491e-a3e4-951d8109930e","Type":"ContainerDied","Data":"091f5829c0382613e9017cdb57f6815327b87ada2a6199637c11d542fcd88580"}
Aug 04 15:30:04.900697 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:04.900673    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"
Aug 04 15:30:05.777687 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:05.777655    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm" event={"ID":"6d1b624c-719b-491e-a3e4-951d8109930e","Type":"ContainerDied","Data":"51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82"}
Aug 04 15:30:05.777858 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:05.777707    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51196d4b96f0880440d0d7da9abe42c4b823c8ddceec4f4b7ee265ba0da5df82"
Aug 04 15:30:05.777858 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:05.777670    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29764290-dt7hm"
Aug 04 15:30:45.694913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:30:45.694821    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:32:36.624576 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:36.624462    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:32:43.504880 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.504843    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:32:43.505326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.505312    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d1b624c-719b-491e-a3e4-951d8109930e" containerName="cleanup"
Aug 04 15:32:43.505326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.505327    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d1b624c-719b-491e-a3e4-951d8109930e" containerName="cleanup"
Aug 04 15:32:43.505416 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.505393    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d1b624c-719b-491e-a3e4-951d8109930e" containerName="cleanup"
Aug 04 15:32:43.508571 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.508552    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.511527 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.511504    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-ffe4e6a1-kserve-self-signed-certs\""
Aug 04 15:32:43.520913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.520881    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:32:43.535723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.535680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:32:43.607230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.607456 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607240    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5jsg\" (UniqueName: \"kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.607519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607461    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.607519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.607626 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607534    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.607681 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.607642    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708236 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708202    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5jsg\" (UniqueName: \"kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708432 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708258    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708432 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708336    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708432 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708794 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708766    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708836    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.708946 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.708895    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.710691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.710668    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.711060 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.711041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.717269 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.717241    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5jsg\" (UniqueName: \"kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg\") pod \"e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") " pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.817606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.817500    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:43.979688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:43.979655    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:32:43.981567 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:32:43.981528    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9075a448_3a0e_4a25_8bec_2a29116e0de4.slice/crio-f9058842bb0b38cc509e9090d27ea56e8a72ee434af358ad7c32612af1f9058b WatchSource:0}: Error finding container f9058842bb0b38cc509e9090d27ea56e8a72ee434af358ad7c32612af1f9058b: Status 404 returned error can't find the container with id f9058842bb0b38cc509e9090d27ea56e8a72ee434af358ad7c32612af1f9058b
Aug 04 15:32:44.588528 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:44.588481    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" event={"ID":"9075a448-3a0e-4a25-8bec-2a29116e0de4","Type":"ContainerStarted","Data":"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"}
Aug 04 15:32:44.588528 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:44.588529    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" event={"ID":"9075a448-3a0e-4a25-8bec-2a29116e0de4","Type":"ContainerStarted","Data":"f9058842bb0b38cc509e9090d27ea56e8a72ee434af358ad7c32612af1f9058b"}
Aug 04 15:32:44.609587 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:44.609535    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" podStartSLOduration=1.609517511 podStartE2EDuration="1.609517511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:32:44.608577623 +0000 UTC m=+1557.440545740" watchObservedRunningTime="2026-08-04 15:32:44.609517511 +0000 UTC m=+1557.441485686"
Aug 04 15:32:53.818443 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:53.818401    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:53.818443 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:53.818451    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:53.830932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:53.830903    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:32:54.649000 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:32:54.648975    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:33:08.618434 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:08.618382    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:33:10.147224 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:10.147190    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:33:10.175979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:10.175943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:33:25.169228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.169168    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" podUID="9075a448-3a0e-4a25-8bec-2a29116e0de4" containerName="main" containerID="cri-o://0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9" gracePeriod=45
Aug 04 15:33:25.410590 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.410566    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:33:25.515174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515107    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515138    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515204    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5jsg\" (UniqueName: \"kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515262    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515339    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs\") pod \"9075a448-3a0e-4a25-8bec-2a29116e0de4\" (UID: \"9075a448-3a0e-4a25-8bec-2a29116e0de4\") "
Aug 04 15:33:25.515390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515359    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:33:25.515655 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515502    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home" (OuterVolumeSpecName: "home") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:33:25.515655 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515576    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache" (OuterVolumeSpecName: "model-cache") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:33:25.515736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515701    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-tmp-dir\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.515736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515716    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-home\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.515736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.515725    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-model-cache\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.517477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.517451    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:33:25.517691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.517663    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm" (OuterVolumeSpecName: "dshm") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:33:25.517785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.517732    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg" (OuterVolumeSpecName: "kube-api-access-t5jsg") pod "9075a448-3a0e-4a25-8bec-2a29116e0de4" (UID: "9075a448-3a0e-4a25-8bec-2a29116e0de4"). InnerVolumeSpecName "kube-api-access-t5jsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:33:25.616245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.616222    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5jsg\" (UniqueName: \"kubernetes.io/projected/9075a448-3a0e-4a25-8bec-2a29116e0de4-kube-api-access-t5jsg\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.616245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.616244    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9075a448-3a0e-4a25-8bec-2a29116e0de4-dshm\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.616402 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.616256    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9075a448-3a0e-4a25-8bec-2a29116e0de4-tls-certs\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:33:25.795230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.795158    2571 generic.go:356] "Generic (PLEG): container finished" podID="9075a448-3a0e-4a25-8bec-2a29116e0de4" containerID="0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9" exitCode=0
Aug 04 15:33:25.795230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.795199    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"
Aug 04 15:33:25.795433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.795243    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" event={"ID":"9075a448-3a0e-4a25-8bec-2a29116e0de4","Type":"ContainerDied","Data":"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"}
Aug 04 15:33:25.795433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.795303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26" event={"ID":"9075a448-3a0e-4a25-8bec-2a29116e0de4","Type":"ContainerDied","Data":"f9058842bb0b38cc509e9090d27ea56e8a72ee434af358ad7c32612af1f9058b"}
Aug 04 15:33:25.795433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.795323    2571 scope.go:117] "RemoveContainer" containerID="0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"
Aug 04 15:33:25.803949 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.803935    2571 scope.go:117] "RemoveContainer" containerID="0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"
Aug 04 15:33:25.804199 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:33:25.804178    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9\": container with ID starting with 0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9 not found: ID does not exist" containerID="0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"
Aug 04 15:33:25.804259 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.804209    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9"} err="failed to get container status \"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9\": rpc error: code = NotFound desc = could not find container \"0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9\": container with ID starting with 0a281db23676ca4b500c61f10d3a3665262c3671f82abc36e48c59d8995879c9 not found: ID does not exist"
Aug 04 15:33:25.815391 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.815369    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:33:25.820677 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:25.820658    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-ffe4e6a1-kserve-6664b59c6c-78j26"]
Aug 04 15:33:27.725132 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:33:27.725103    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9075a448-3a0e-4a25-8bec-2a29116e0de4" path="/var/lib/kubelet/pods/9075a448-3a0e-4a25-8bec-2a29116e0de4/volumes"
Aug 04 15:34:01.402713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:34:01.402662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:34:03.160137 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:34:03.160101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:34:39.400083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:34:39.400041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:36:34.245703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:36:34.245664    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:00.804689 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:00.804652    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:37.658599 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:37.658561    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:40.945478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:40.945431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:41.047607 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:41.047576    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:41.418395 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:41.418354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:47.610693 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:47.610655    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:47.694350 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:47.694319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:47.869116 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:47.869052    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:48.247248 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:48.247217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:48.498014 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:48.497940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:50.446360 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:50.446324    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:50.671209 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:50.671172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:51.771961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.771929    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:37:51.772403 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.772388    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9075a448-3a0e-4a25-8bec-2a29116e0de4" containerName="main"
Aug 04 15:37:51.772403 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.772403    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9075a448-3a0e-4a25-8bec-2a29116e0de4" containerName="main"
Aug 04 15:37:51.772488 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.772474    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9075a448-3a0e-4a25-8bec-2a29116e0de4" containerName="main"
Aug 04 15:37:51.775603 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.775586    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.779315 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.779274    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-dc6f2748-serving-cert\""
Aug 04 15:37:51.803524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.803505    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:37:51.817552 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.817533    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.817652 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.817576    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrclh\" (UniqueName: \"kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.817872 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.817645    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.876403 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.876374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:51.918715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.918686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.918831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.918735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrclh\" (UniqueName: \"kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.918831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.918775    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.918912 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:37:51.918832    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-serving-cert: secret "maas-api-e2e-ait-dc6f2748-serving-cert" not found
Aug 04 15:37:51.918912 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:37:51.918892    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls podName:e178ad35-a368-49d6-86af-9adc40548c51 nodeName:}" failed. No retries permitted until 2026-08-04 15:37:52.418873817 +0000 UTC m=+1865.250841922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls") pod "maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" (UID: "e178ad35-a368-49d6-86af-9adc40548c51") : secret "maas-api-e2e-ait-dc6f2748-serving-cert" not found
Aug 04 15:37:51.919445 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.919427    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:51.949480 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:51.949451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrclh\" (UniqueName: \"kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:52.424436 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.424393    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:52.426684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.426655    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") pod \"maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:52.453632 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.453601    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:52.686601 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.686510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:52.827477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.827328    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:37:52.831213 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:37:52.831177    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode178ad35_a368_49d6_86af_9adc40548c51.slice/crio-8a5cc1d6bc413616828d31aa75629308c9e2d671921c020fe348f259914a0635 WatchSource:0}: Error finding container 8a5cc1d6bc413616828d31aa75629308c9e2d671921c020fe348f259914a0635: Status 404 returned error can't find the container with id 8a5cc1d6bc413616828d31aa75629308c9e2d671921c020fe348f259914a0635
Aug 04 15:37:52.832998 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.832975    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:37:52.935159 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:52.935125    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:53.118237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.118146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:37:53.172727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.172693    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" event={"ID":"e178ad35-a368-49d6-86af-9adc40548c51","Type":"ContainerStarted","Data":"8a5cc1d6bc413616828d31aa75629308c9e2d671921c020fe348f259914a0635"}
Aug 04 15:37:53.195447 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.195412    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:37:53.200062 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.200043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.210416 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.210393    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-dc6f2748-dockercfg-89z64\""
Aug 04 15:37:53.210778 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.210761    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-dc6f2748\""
Aug 04 15:37:53.231568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.231535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmbhm\" (UniqueName: \"kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.231717 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.231650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.235266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.235238    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:37:53.300286 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.300250    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:37:53.303777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.303761    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.321795 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.321764    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:37:53.332978 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.332950    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmbhm\" (UniqueName: \"kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.333113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.333004    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.333113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.333048    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.333113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.333082    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtpz\" (UniqueName: \"kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.333792 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.333772    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.352482 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.352458    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmbhm\" (UniqueName: \"kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm\") pod \"payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") " pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.434216 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.434181    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.434411 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.434237    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtpz\" (UniqueName: \"kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.434969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.434945    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.450020 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.449992    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtpz\" (UniqueName: \"kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz\") pod \"payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.510841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.510808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:53.613716 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.613688    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:53.676034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.675078    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:37:53.678034 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:37:53.678007    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8583046_0a27_4c51_8afb_333a81a1f1cf.slice/crio-0887cf059d1caa4b828a70ec3efc686de1308c0d947ccad0f04c344feb7ef1af WatchSource:0}: Error finding container 0887cf059d1caa4b828a70ec3efc686de1308c0d947ccad0f04c344feb7ef1af: Status 404 returned error can't find the container with id 0887cf059d1caa4b828a70ec3efc686de1308c0d947ccad0f04c344feb7ef1af
Aug 04 15:37:53.788460 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:53.788432    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:37:53.789206 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:37:53.789185    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda03f4c20_1034_43e8_a872_c500adc2d7dc.slice/crio-bdb9f0fe968a4cacbb625fcc6fd415126721f4d7601038465caf94324e6f5faf WatchSource:0}: Error finding container bdb9f0fe968a4cacbb625fcc6fd415126721f4d7601038465caf94324e6f5faf: Status 404 returned error can't find the container with id bdb9f0fe968a4cacbb625fcc6fd415126721f4d7601038465caf94324e6f5faf
Aug 04 15:37:54.179590 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.179553    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" event={"ID":"f8583046-0a27-4c51-8afb-333a81a1f1cf","Type":"ContainerStarted","Data":"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"}
Aug 04 15:37:54.180049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.179621    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" event={"ID":"f8583046-0a27-4c51-8afb-333a81a1f1cf","Type":"ContainerStarted","Data":"0887cf059d1caa4b828a70ec3efc686de1308c0d947ccad0f04c344feb7ef1af"}
Aug 04 15:37:54.180049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.179746    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:37:54.181124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.181097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" event={"ID":"a03f4c20-1034-43e8-a872-c500adc2d7dc","Type":"ContainerStarted","Data":"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"}
Aug 04 15:37:54.181226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.181144    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" event={"ID":"a03f4c20-1034-43e8-a872-c500adc2d7dc","Type":"ContainerStarted","Data":"bdb9f0fe968a4cacbb625fcc6fd415126721f4d7601038465caf94324e6f5faf"}
Aug 04 15:37:54.181226 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.181177    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:37:54.252873 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.252822    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" podStartSLOduration=1.252803431 podStartE2EDuration="1.252803431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:37:54.250698848 +0000 UTC m=+1867.082666966" watchObservedRunningTime="2026-08-04 15:37:54.252803431 +0000 UTC m=+1867.084771548"
Aug 04 15:37:54.253429 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:54.253398    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" podStartSLOduration=1.253389433 podStartE2EDuration="1.253389433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:37:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:37:54.216214169 +0000 UTC m=+1867.048182286" watchObservedRunningTime="2026-08-04 15:37:54.253389433 +0000 UTC m=+1867.085357574"
Aug 04 15:37:55.188300 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:55.188250    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" event={"ID":"e178ad35-a368-49d6-86af-9adc40548c51","Type":"ContainerStarted","Data":"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"}
Aug 04 15:37:55.188674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:55.188513    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:37:55.217695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:37:55.217648    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" podStartSLOduration=2.196438163 podStartE2EDuration="4.217634692s" totalImagesPullingTime="2.021196529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:37:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:37:55.216838777 +0000 UTC m=+1868.048806905" watchObservedRunningTime="2026-08-04 15:37:55.217634692 +0000 UTC m=+1868.049602809"
Aug 04 15:38:01.198925 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:01.198897    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:38:05.190338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:05.190305    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:38:05.190714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:05.190381    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:38:32.547284 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.547250    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:38:32.550012 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.547530    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" podUID="e178ad35-a368-49d6-86af-9adc40548c51" containerName="maas-api" containerID="cri-o://6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af" gracePeriod=30
Aug 04 15:38:32.598062 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.598035    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:38:32.598255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.598224    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" podUID="f8583046-0a27-4c51-8afb-333a81a1f1cf" containerName="payload-processing" containerID="cri-o://10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb" gracePeriod=30
Aug 04 15:38:32.606320 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.606277    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:38:32.606688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.606658    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" podUID="a03f4c20-1034-43e8-a872-c500adc2d7dc" containerName="payload-pre-processing" containerID="cri-o://477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343" gracePeriod=30
Aug 04 15:38:32.882215 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.882185    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:38:32.885077 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.885055    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:38:32.891612 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca\") pod \"e178ad35-a368-49d6-86af-9adc40548c51\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") "
Aug 04 15:38:32.891699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891651    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume\") pod \"f8583046-0a27-4c51-8afb-333a81a1f1cf\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") "
Aug 04 15:38:32.891748 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891711    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lrclh\" (UniqueName: \"kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh\") pod \"e178ad35-a368-49d6-86af-9adc40548c51\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") "
Aug 04 15:38:32.891791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891768    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmbhm\" (UniqueName: \"kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm\") pod \"f8583046-0a27-4c51-8afb-333a81a1f1cf\" (UID: \"f8583046-0a27-4c51-8afb-333a81a1f1cf\") "
Aug 04 15:38:32.891845 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891815    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") pod \"e178ad35-a368-49d6-86af-9adc40548c51\" (UID: \"e178ad35-a368-49d6-86af-9adc40548c51\") "
Aug 04 15:38:32.891913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891882    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e178ad35-a368-49d6-86af-9adc40548c51" (UID: "e178ad35-a368-49d6-86af-9adc40548c51"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:38:32.891989 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.891968    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8583046-0a27-4c51-8afb-333a81a1f1cf" (UID: "f8583046-0a27-4c51-8afb-333a81a1f1cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:38:32.892148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.892128    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e178ad35-a368-49d6-86af-9adc40548c51-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:32.892148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.892145    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8583046-0a27-4c51-8afb-333a81a1f1cf-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:32.894019 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.893994    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e178ad35-a368-49d6-86af-9adc40548c51" (UID: "e178ad35-a368-49d6-86af-9adc40548c51"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:38:32.894120 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.893992    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh" (OuterVolumeSpecName: "kube-api-access-lrclh") pod "e178ad35-a368-49d6-86af-9adc40548c51" (UID: "e178ad35-a368-49d6-86af-9adc40548c51"). InnerVolumeSpecName "kube-api-access-lrclh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:38:32.894120 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.894053    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm" (OuterVolumeSpecName: "kube-api-access-hmbhm") pod "f8583046-0a27-4c51-8afb-333a81a1f1cf" (UID: "f8583046-0a27-4c51-8afb-333a81a1f1cf"). InnerVolumeSpecName "kube-api-access-hmbhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:38:32.902948 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.902930    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:38:32.992576 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.992541    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqtpz\" (UniqueName: \"kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz\") pod \"a03f4c20-1034-43e8-a872-c500adc2d7dc\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") "
Aug 04 15:38:32.992750 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.992653    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume\") pod \"a03f4c20-1034-43e8-a872-c500adc2d7dc\" (UID: \"a03f4c20-1034-43e8-a872-c500adc2d7dc\") "
Aug 04 15:38:32.992835 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.992823    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e178ad35-a368-49d6-86af-9adc40548c51-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:32.992902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.992836    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lrclh\" (UniqueName: \"kubernetes.io/projected/e178ad35-a368-49d6-86af-9adc40548c51-kube-api-access-lrclh\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:32.992902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.992847    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmbhm\" (UniqueName: \"kubernetes.io/projected/f8583046-0a27-4c51-8afb-333a81a1f1cf-kube-api-access-hmbhm\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:32.993071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.993047    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a03f4c20-1034-43e8-a872-c500adc2d7dc" (UID: "a03f4c20-1034-43e8-a872-c500adc2d7dc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:38:32.994515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:32.994492    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz" (OuterVolumeSpecName: "kube-api-access-wqtpz") pod "a03f4c20-1034-43e8-a872-c500adc2d7dc" (UID: "a03f4c20-1034-43e8-a872-c500adc2d7dc"). InnerVolumeSpecName "kube-api-access-wqtpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:38:33.093996 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.093925    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqtpz\" (UniqueName: \"kubernetes.io/projected/a03f4c20-1034-43e8-a872-c500adc2d7dc-kube-api-access-wqtpz\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:33.093996 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.093950    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a03f4c20-1034-43e8-a872-c500adc2d7dc-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:38:33.384396 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.384365    2571 generic.go:356] "Generic (PLEG): container finished" podID="e178ad35-a368-49d6-86af-9adc40548c51" containerID="6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af" exitCode=0
Aug 04 15:38:33.384558 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.384420    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"
Aug 04 15:38:33.384558 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.384464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" event={"ID":"e178ad35-a368-49d6-86af-9adc40548c51","Type":"ContainerDied","Data":"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"}
Aug 04 15:38:33.384558 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.384530    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5" event={"ID":"e178ad35-a368-49d6-86af-9adc40548c51","Type":"ContainerDied","Data":"8a5cc1d6bc413616828d31aa75629308c9e2d671921c020fe348f259914a0635"}
Aug 04 15:38:33.384685 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.384565    2571 scope.go:117] "RemoveContainer" containerID="6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"
Aug 04 15:38:33.385844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.385821    2571 generic.go:356] "Generic (PLEG): container finished" podID="f8583046-0a27-4c51-8afb-333a81a1f1cf" containerID="10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb" exitCode=0
Aug 04 15:38:33.385940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.385864    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"
Aug 04 15:38:33.385940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.385911    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" event={"ID":"f8583046-0a27-4c51-8afb-333a81a1f1cf","Type":"ContainerDied","Data":"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"}
Aug 04 15:38:33.386049 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.385961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z" event={"ID":"f8583046-0a27-4c51-8afb-333a81a1f1cf","Type":"ContainerDied","Data":"0887cf059d1caa4b828a70ec3efc686de1308c0d947ccad0f04c344feb7ef1af"}
Aug 04 15:38:33.387339 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.387311    2571 generic.go:356] "Generic (PLEG): container finished" podID="a03f4c20-1034-43e8-a872-c500adc2d7dc" containerID="477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343" exitCode=0
Aug 04 15:38:33.387478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.387359    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"
Aug 04 15:38:33.387478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.387378    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" event={"ID":"a03f4c20-1034-43e8-a872-c500adc2d7dc","Type":"ContainerDied","Data":"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"}
Aug 04 15:38:33.387478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.387422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl" event={"ID":"a03f4c20-1034-43e8-a872-c500adc2d7dc","Type":"ContainerDied","Data":"bdb9f0fe968a4cacbb625fcc6fd415126721f4d7601038465caf94324e6f5faf"}
Aug 04 15:38:33.390502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.390450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:33.395716 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.395558    2571 scope.go:117] "RemoveContainer" containerID="6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"
Aug 04 15:38:33.395994 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:38:33.395969    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af\": container with ID starting with 6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af not found: ID does not exist" containerID="6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"
Aug 04 15:38:33.396070 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.396008    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af"} err="failed to get container status \"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af\": rpc error: code = NotFound desc = could not find container \"6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af\": container with ID starting with 6feed24310a09887bec64c5f722e317bf7e090246fa7b5568cc46e5d84ce88af not found: ID does not exist"
Aug 04 15:38:33.396070 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.396032    2571 scope.go:117] "RemoveContainer" containerID="10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"
Aug 04 15:38:33.405103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.405084    2571 scope.go:117] "RemoveContainer" containerID="10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"
Aug 04 15:38:33.405361 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:38:33.405345    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb\": container with ID starting with 10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb not found: ID does not exist" containerID="10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"
Aug 04 15:38:33.405421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.405367    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb"} err="failed to get container status \"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb\": rpc error: code = NotFound desc = could not find container \"10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb\": container with ID starting with 10a21936124ba5b2ad313f712a9c284d533c0543119c084b61acc0057c8279eb not found: ID does not exist"
Aug 04 15:38:33.405421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.405382    2571 scope.go:117] "RemoveContainer" containerID="477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"
Aug 04 15:38:33.413107 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.413087    2571 scope.go:117] "RemoveContainer" containerID="477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"
Aug 04 15:38:33.413415 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:38:33.413395    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343\": container with ID starting with 477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343 not found: ID does not exist" containerID="477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"
Aug 04 15:38:33.413485 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.413420    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343"} err="failed to get container status \"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343\": rpc error: code = NotFound desc = could not find container \"477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343\": container with ID starting with 477818b7b1db45cc0149fe19ff28f911051db219f7c2b3258b4e994b02008343 not found: ID does not exist"
Aug 04 15:38:33.415013 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.414991    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:38:33.418085 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.418066    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-dc6f2748-58d55b8dfd-5pzz5"]
Aug 04 15:38:33.432914 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.432896    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:38:33.444531 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.441416    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-dc6f2748-85f8ffb57b-xc2hl"]
Aug 04 15:38:33.455080 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.455055    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:38:33.467791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.467772    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-dc6f2748-7c79946d48-tqm8z"]
Aug 04 15:38:33.503588 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.503560    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:33.687593 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.687518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:33.724046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.724013    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a03f4c20-1034-43e8-a872-c500adc2d7dc" path="/var/lib/kubelet/pods/a03f4c20-1034-43e8-a872-c500adc2d7dc/volumes"
Aug 04 15:38:33.724478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.724462    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e178ad35-a368-49d6-86af-9adc40548c51" path="/var/lib/kubelet/pods/e178ad35-a368-49d6-86af-9adc40548c51/volumes"
Aug 04 15:38:33.724791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.724778    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8583046-0a27-4c51-8afb-333a81a1f1cf" path="/var/lib/kubelet/pods/f8583046-0a27-4c51-8afb-333a81a1f1cf/volumes"
Aug 04 15:38:33.802777 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:33.802756    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:34.275489 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:34.275455    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:34.426581 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:34.426543    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:36.827530 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.827499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:36.928253 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928226    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:38:36.928714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928697    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8583046-0a27-4c51-8afb-333a81a1f1cf" containerName="payload-processing"
Aug 04 15:38:36.928809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928717    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8583046-0a27-4c51-8afb-333a81a1f1cf" containerName="payload-processing"
Aug 04 15:38:36.928809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928739    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a03f4c20-1034-43e8-a872-c500adc2d7dc" containerName="payload-pre-processing"
Aug 04 15:38:36.928809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928747    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a03f4c20-1034-43e8-a872-c500adc2d7dc" containerName="payload-pre-processing"
Aug 04 15:38:36.928809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928761    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e178ad35-a368-49d6-86af-9adc40548c51" containerName="maas-api"
Aug 04 15:38:36.928809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928770    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e178ad35-a368-49d6-86af-9adc40548c51" containerName="maas-api"
Aug 04 15:38:36.929123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928859    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8583046-0a27-4c51-8afb-333a81a1f1cf" containerName="payload-processing"
Aug 04 15:38:36.929123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928874    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e178ad35-a368-49d6-86af-9adc40548c51" containerName="maas-api"
Aug 04 15:38:36.929123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.928883    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a03f4c20-1034-43e8-a872-c500adc2d7dc" containerName="payload-pre-processing"
Aug 04 15:38:36.933927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.933902    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:36.937304 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.937268    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2a0c7713-serving-cert\""
Aug 04 15:38:36.954080 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:36.954057    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:38:37.032841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.032817    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpvhd\" (UniqueName: \"kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.032991 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.032880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.032991 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.032956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.133649 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.133625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpvhd\" (UniqueName: \"kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.133787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.133686    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.133787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.133755    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.134380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.134360    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.135961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.135943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.144584 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.144561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpvhd\" (UniqueName: \"kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd\") pod \"maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.243473 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.243450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:37.244285 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.244266    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:37.349808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.349762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:37.384769 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.384170    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:38:37.394050 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:38:37.394023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ddefaa1_a043_4ca2_82fa_05fa8ccf87e8.slice/crio-e124ab0be23bc4c8ecb22c8c5edbefe9a2c0fa562f830b28ee3ccb61f3febab7 WatchSource:0}: Error finding container e124ab0be23bc4c8ecb22c8c5edbefe9a2c0fa562f830b28ee3ccb61f3febab7: Status 404 returned error can't find the container with id e124ab0be23bc4c8ecb22c8c5edbefe9a2c0fa562f830b28ee3ccb61f3febab7
Aug 04 15:38:37.411981 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.411951    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" event={"ID":"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8","Type":"ContainerStarted","Data":"e124ab0be23bc4c8ecb22c8c5edbefe9a2c0fa562f830b28ee3ccb61f3febab7"}
Aug 04 15:38:37.753072 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.752970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:37.847595 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.847567    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:38:37.960786 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.960753    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:38:37.965395 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.965377    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:37.969256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.969235    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-2a0c7713-dockercfg-wkvw6\""
Aug 04 15:38:37.977695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.977679    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-2a0c7713\""
Aug 04 15:38:37.989394 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:37.989373    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:38:38.010921 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.010871    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:38:38.014285 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.014271    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.042649 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.042620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.042758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.042657    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t5sk\" (UniqueName: \"kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.042816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.042795    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xcw4\" (UniqueName: \"kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.042873 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.042825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.064243 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.064219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:38:38.143334 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.143304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xcw4\" (UniqueName: \"kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.143430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.143339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.143430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.143418    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.143514 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.143443    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t5sk\" (UniqueName: \"kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.144103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.144082    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.144145 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.144126    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.160652 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.160625    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xcw4\" (UniqueName: \"kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4\") pod \"payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.168075 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.168054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t5sk\" (UniqueName: \"kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk\") pod \"payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") " pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.276404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.276340    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:38.324382 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.324349    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:38.459515 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.459484    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:38:38.461308 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:38:38.461250    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a20a24_6021_4418_b5eb_6b8311ca1bf4.slice/crio-b6913ef4dcb9cbb1de2dfb9cbb1be062d321391f0e83b73971de8d3918e43275 WatchSource:0}: Error finding container b6913ef4dcb9cbb1de2dfb9cbb1be062d321391f0e83b73971de8d3918e43275: Status 404 returned error can't find the container with id b6913ef4dcb9cbb1de2dfb9cbb1be062d321391f0e83b73971de8d3918e43275
Aug 04 15:38:38.689613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:38.689588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:38:38.690741 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:38:38.690714    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3b53fa_a4dd_4b73_9bf2_6ae807247847.slice/crio-7dca83a444bb09ac63dd481fcd71dc000c60e97f0eddf360ef917bac298613ca WatchSource:0}: Error finding container 7dca83a444bb09ac63dd481fcd71dc000c60e97f0eddf360ef917bac298613ca: Status 404 returned error can't find the container with id 7dca83a444bb09ac63dd481fcd71dc000c60e97f0eddf360ef917bac298613ca
Aug 04 15:38:39.426390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.426350    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" event={"ID":"fe3b53fa-a4dd-4b73-9bf2-6ae807247847","Type":"ContainerStarted","Data":"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"}
Aug 04 15:38:39.426820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.426423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" event={"ID":"fe3b53fa-a4dd-4b73-9bf2-6ae807247847","Type":"ContainerStarted","Data":"7dca83a444bb09ac63dd481fcd71dc000c60e97f0eddf360ef917bac298613ca"}
Aug 04 15:38:39.426820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.426461    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:38:39.427988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.427958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" event={"ID":"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8","Type":"ContainerStarted","Data":"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"}
Aug 04 15:38:39.428076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.428016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:39.429522 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.429501    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" event={"ID":"c3a20a24-6021-4418-b5eb-6b8311ca1bf4","Type":"ContainerStarted","Data":"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"}
Aug 04 15:38:39.429647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.429544    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" event={"ID":"c3a20a24-6021-4418-b5eb-6b8311ca1bf4","Type":"ContainerStarted","Data":"b6913ef4dcb9cbb1de2dfb9cbb1be062d321391f0e83b73971de8d3918e43275"}
Aug 04 15:38:39.429647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.429578    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:39.453237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.453192    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" podStartSLOduration=2.453178675 podStartE2EDuration="2.453178675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:38:39.451544081 +0000 UTC m=+1912.283512222" watchObservedRunningTime="2026-08-04 15:38:39.453178675 +0000 UTC m=+1912.285146792"
Aug 04 15:38:39.474155 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.474106    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" podStartSLOduration=1.892881512 podStartE2EDuration="3.474087536s" totalImagesPullingTime="1.581206024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:38:39.471322554 +0000 UTC m=+1912.303290671" watchObservedRunningTime="2026-08-04 15:38:39.474087536 +0000 UTC m=+1912.306055653"
Aug 04 15:38:39.490384 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:39.490338    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" podStartSLOduration=2.490321185 podStartE2EDuration="2.490321185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:38:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:38:39.489319026 +0000 UTC m=+1912.321287144" watchObservedRunningTime="2026-08-04 15:38:39.490321185 +0000 UTC m=+1912.322289306"
Aug 04 15:38:45.442052 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:45.442013    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:38:50.437904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:50.437872    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:38:50.438378 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:38:50.437941    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:39:08.557390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.557274    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:39:08.557927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.557538    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" podUID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" containerName="maas-api" containerID="cri-o://00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e" gracePeriod=30
Aug 04 15:39:08.601709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.601680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:08.637184 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.637160    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:39:08.637454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.637428    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" podUID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" containerName="payload-processing" containerID="cri-o://470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92" gracePeriod=30
Aug 04 15:39:08.647832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.647776    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:39:08.648067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.648009    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" podUID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" containerName="payload-pre-processing" containerID="cri-o://f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50" gracePeriod=30
Aug 04 15:39:08.913075 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.913047    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:39:08.915926 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.915907    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:39:08.927813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:08.927794    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:39:09.011106 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011081    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls\") pod \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") "
Aug 04 15:39:09.011240 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011154    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t5sk\" (UniqueName: \"kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk\") pod \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") "
Aug 04 15:39:09.011240 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011185    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca\") pod \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") "
Aug 04 15:39:09.011240 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume\") pod \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\" (UID: \"fe3b53fa-a4dd-4b73-9bf2-6ae807247847\") "
Aug 04 15:39:09.011386 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011268    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpvhd\" (UniqueName: \"kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd\") pod \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\" (UID: \"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8\") "
Aug 04 15:39:09.011573 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011546    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" (UID: "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:09.011684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.011647    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fe3b53fa-a4dd-4b73-9bf2-6ae807247847" (UID: "fe3b53fa-a4dd-4b73-9bf2-6ae807247847"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:09.013415 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.013392    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd" (OuterVolumeSpecName: "kube-api-access-zpvhd") pod "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" (UID: "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8"). InnerVolumeSpecName "kube-api-access-zpvhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:09.013745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.013716    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" (UID: "0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:39:09.013745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.013726    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk" (OuterVolumeSpecName: "kube-api-access-8t5sk") pod "fe3b53fa-a4dd-4b73-9bf2-6ae807247847" (UID: "fe3b53fa-a4dd-4b73-9bf2-6ae807247847"). InnerVolumeSpecName "kube-api-access-8t5sk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:09.112838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.112765    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xcw4\" (UniqueName: \"kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4\") pod \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") "
Aug 04 15:39:09.112838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.112805    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume\") pod \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\" (UID: \"c3a20a24-6021-4418-b5eb-6b8311ca1bf4\") "
Aug 04 15:39:09.113045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113016    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t5sk\" (UniqueName: \"kubernetes.io/projected/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-kube-api-access-8t5sk\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.113045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113026    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.113045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113036    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fe3b53fa-a4dd-4b73-9bf2-6ae807247847-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.113045 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113044    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpvhd\" (UniqueName: \"kubernetes.io/projected/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-kube-api-access-zpvhd\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.113256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113053    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.113256 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.113226    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3a20a24-6021-4418-b5eb-6b8311ca1bf4" (UID: "c3a20a24-6021-4418-b5eb-6b8311ca1bf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:09.114684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.114664    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4" (OuterVolumeSpecName: "kube-api-access-7xcw4") pod "c3a20a24-6021-4418-b5eb-6b8311ca1bf4" (UID: "c3a20a24-6021-4418-b5eb-6b8311ca1bf4"). InnerVolumeSpecName "kube-api-access-7xcw4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:09.214375 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.214347    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xcw4\" (UniqueName: \"kubernetes.io/projected/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-kube-api-access-7xcw4\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.214375 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.214370    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3a20a24-6021-4418-b5eb-6b8311ca1bf4-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:09.598628 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.598591    2571 generic.go:356] "Generic (PLEG): container finished" podID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" containerID="00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e" exitCode=0
Aug 04 15:39:09.599003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.598640    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"
Aug 04 15:39:09.599003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.598676    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" event={"ID":"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8","Type":"ContainerDied","Data":"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"}
Aug 04 15:39:09.599003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.598726    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh" event={"ID":"0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8","Type":"ContainerDied","Data":"e124ab0be23bc4c8ecb22c8c5edbefe9a2c0fa562f830b28ee3ccb61f3febab7"}
Aug 04 15:39:09.599003 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.598751    2571 scope.go:117] "RemoveContainer" containerID="00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"
Aug 04 15:39:09.600188 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.600166    2571 generic.go:356] "Generic (PLEG): container finished" podID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" containerID="f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50" exitCode=0
Aug 04 15:39:09.600268 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.600220    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"
Aug 04 15:39:09.600359 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.600266    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" event={"ID":"c3a20a24-6021-4418-b5eb-6b8311ca1bf4","Type":"ContainerDied","Data":"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"}
Aug 04 15:39:09.600359 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.600343    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9" event={"ID":"c3a20a24-6021-4418-b5eb-6b8311ca1bf4","Type":"ContainerDied","Data":"b6913ef4dcb9cbb1de2dfb9cbb1be062d321391f0e83b73971de8d3918e43275"}
Aug 04 15:39:09.601743 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.601722    2571 generic.go:356] "Generic (PLEG): container finished" podID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" containerID="470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92" exitCode=0
Aug 04 15:39:09.601849 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.601819    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"
Aug 04 15:39:09.601849 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.601830    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" event={"ID":"fe3b53fa-a4dd-4b73-9bf2-6ae807247847","Type":"ContainerDied","Data":"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"}
Aug 04 15:39:09.601958 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.601869    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l" event={"ID":"fe3b53fa-a4dd-4b73-9bf2-6ae807247847","Type":"ContainerDied","Data":"7dca83a444bb09ac63dd481fcd71dc000c60e97f0eddf360ef917bac298613ca"}
Aug 04 15:39:09.609074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.609047    2571 scope.go:117] "RemoveContainer" containerID="00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"
Aug 04 15:39:09.609381 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:09.609360    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e\": container with ID starting with 00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e not found: ID does not exist" containerID="00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"
Aug 04 15:39:09.609458 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.609386    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e"} err="failed to get container status \"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e\": rpc error: code = NotFound desc = could not find container \"00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e\": container with ID starting with 00c805ffccf45a2cc1d5a18961859e617ebbf57e3f4eef571f02f961bae5750e not found: ID does not exist"
Aug 04 15:39:09.609458 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.609406    2571 scope.go:117] "RemoveContainer" containerID="f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"
Aug 04 15:39:09.617837 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.617818    2571 scope.go:117] "RemoveContainer" containerID="f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"
Aug 04 15:39:09.618064 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:09.618045    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50\": container with ID starting with f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50 not found: ID does not exist" containerID="f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"
Aug 04 15:39:09.618141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.618073    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50"} err="failed to get container status \"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50\": rpc error: code = NotFound desc = could not find container \"f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50\": container with ID starting with f2e22130388579a5cc3e155d701552200180de856431de6a5cec58d200567f50 not found: ID does not exist"
Aug 04 15:39:09.618141 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.618096    2571 scope.go:117] "RemoveContainer" containerID="470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"
Aug 04 15:39:09.625264 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.625250    2571 scope.go:117] "RemoveContainer" containerID="470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"
Aug 04 15:39:09.625514 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:09.625495    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92\": container with ID starting with 470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92 not found: ID does not exist" containerID="470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"
Aug 04 15:39:09.625567 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.625523    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92"} err="failed to get container status \"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92\": rpc error: code = NotFound desc = could not find container \"470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92\": container with ID starting with 470bf328f46d05fc18e7406a257a27b07defdbdacc7c42e0d2d8c73b3d23ff92 not found: ID does not exist"
Aug 04 15:39:09.641388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.641361    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:39:09.649488 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.649471    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2a0c7713-6b4bb4fdbf-mfrvh"]
Aug 04 15:39:09.666282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.666256    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:39:09.674684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.674662    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-2a0c7713-6bdf475bc7-n8z8l"]
Aug 04 15:39:09.689081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.689061    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:39:09.692048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.692028    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-2a0c7713-7b9fd4cc56-d8dv9"]
Aug 04 15:39:09.725040 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.725019    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" path="/var/lib/kubelet/pods/0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8/volumes"
Aug 04 15:39:09.725397 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.725382    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" path="/var/lib/kubelet/pods/c3a20a24-6021-4418-b5eb-6b8311ca1bf4/volumes"
Aug 04 15:39:09.725706 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:09.725694    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" path="/var/lib/kubelet/pods/fe3b53fa-a4dd-4b73-9bf2-6ae807247847/volumes"
Aug 04 15:39:10.048535 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:10.048506    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:10.239477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:10.239452    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:12.921390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:12.921358    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:13.099424 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:13.099398    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:14.002432 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002401    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:14.002835 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002820    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" containerName="payload-processing"
Aug 04 15:39:14.002835 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002836    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" containerName="payload-processing"
Aug 04 15:39:14.002923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002852    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" containerName="maas-api"
Aug 04 15:39:14.002923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002858    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" containerName="maas-api"
Aug 04 15:39:14.002923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002870    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" containerName="payload-pre-processing"
Aug 04 15:39:14.002923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002879    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" containerName="payload-pre-processing"
Aug 04 15:39:14.003044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002958    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ddefaa1-a043-4ca2-82fa-05fa8ccf87e8" containerName="maas-api"
Aug 04 15:39:14.003044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002966    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3a20a24-6021-4418-b5eb-6b8311ca1bf4" containerName="payload-pre-processing"
Aug 04 15:39:14.003044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.002973    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe3b53fa-a4dd-4b73-9bf2-6ae807247847" containerName="payload-processing"
Aug 04 15:39:14.006194 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.006176    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.009313 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.009273    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8202ac71-serving-cert\""
Aug 04 15:39:14.028083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.028061    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:14.051441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.051416    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.051532 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.051471    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zk6wl\" (UniqueName: \"kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.051532 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.051519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.056930 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.056882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:14.152018 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.151993    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.152136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.152042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zk6wl\" (UniqueName: \"kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.152136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.152079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.152689 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.152667    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.154555 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.154535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.164019 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.164000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zk6wl\" (UniqueName: \"kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl\") pod \"maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.205905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.205881    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:14.316365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.316307    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:14.460438 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.460410    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:14.461747 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:14.461721    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9195d6d_55e8_488e_90a3_d97a627cbf76.slice/crio-57f6776998162613fb4e05ca45eccee7ef1828dcc422b6b68bdeded0e246d1a1 WatchSource:0}: Error finding container 57f6776998162613fb4e05ca45eccee7ef1828dcc422b6b68bdeded0e246d1a1: Status 404 returned error can't find the container with id 57f6776998162613fb4e05ca45eccee7ef1828dcc422b6b68bdeded0e246d1a1
Aug 04 15:39:14.626982 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.626911    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:14.638153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.638122    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" event={"ID":"a9195d6d-55e8-488e-90a3-d97a627cbf76","Type":"ContainerStarted","Data":"57f6776998162613fb4e05ca45eccee7ef1828dcc422b6b68bdeded0e246d1a1"}
Aug 04 15:39:14.752813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.752782    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:14.784393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.784359    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:14.789041 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.789021    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.792656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.792637    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8202ac71\""
Aug 04 15:39:14.792733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.792637    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8202ac71-dockercfg-6gp2l\""
Aug 04 15:39:14.802390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.802369    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:14.856739 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.856715    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.856841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.856747    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r5z2\" (UniqueName: \"kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.879744 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.879721    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:14.883904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.883888    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:14.895730 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.895706    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:14.957393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.957368    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.957498 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.957408    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r5z2\" (UniqueName: \"kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.957498 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.957464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:14.957498 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.957492    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcb7x\" (UniqueName: \"kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:14.958047 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.958028    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:14.967365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:14.967339    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r5z2\" (UniqueName: \"kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2\") pod \"payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") " pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:15.058217 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.058182    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.058561 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.058224    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcb7x\" (UniqueName: \"kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.058892 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.058873    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.070585 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.070561    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcb7x\" (UniqueName: \"kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x\") pod \"payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.099868 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.099842    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:15.193899 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.193872    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.339433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.339406    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:15.340648 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:15.340614    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod213c5b21_db9e_4cae_bc1a_2341f7669086.slice/crio-484e4f31267bc1998dc87cb7c4faaf20aa513a7c7d12cc8f80580e5442447c4b WatchSource:0}: Error finding container 484e4f31267bc1998dc87cb7c4faaf20aa513a7c7d12cc8f80580e5442447c4b: Status 404 returned error can't find the container with id 484e4f31267bc1998dc87cb7c4faaf20aa513a7c7d12cc8f80580e5442447c4b
Aug 04 15:39:15.448143 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.448114    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:15.449145 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:15.449122    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode052ee2d_16c0_4736_acff_bf6e11cad592.slice/crio-55da8baeb298b508d0a988e4af43f10337c6cc62119e9bfa40df809d56025b81 WatchSource:0}: Error finding container 55da8baeb298b508d0a988e4af43f10337c6cc62119e9bfa40df809d56025b81: Status 404 returned error can't find the container with id 55da8baeb298b508d0a988e4af43f10337c6cc62119e9bfa40df809d56025b81
Aug 04 15:39:15.645367 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.645329    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" event={"ID":"213c5b21-db9e-4cae-bc1a-2341f7669086","Type":"ContainerStarted","Data":"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"}
Aug 04 15:39:15.645543 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.645393    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" event={"ID":"213c5b21-db9e-4cae-bc1a-2341f7669086","Type":"ContainerStarted","Data":"484e4f31267bc1998dc87cb7c4faaf20aa513a7c7d12cc8f80580e5442447c4b"}
Aug 04 15:39:15.645623 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.645581    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:15.647114 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.647087    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" event={"ID":"a9195d6d-55e8-488e-90a3-d97a627cbf76","Type":"ContainerStarted","Data":"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"}
Aug 04 15:39:15.647255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.647141    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:15.648803 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.648780    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" event={"ID":"e052ee2d-16c0-4736-acff-bf6e11cad592","Type":"ContainerStarted","Data":"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"}
Aug 04 15:39:15.648907 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.648823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" event={"ID":"e052ee2d-16c0-4736-acff-bf6e11cad592","Type":"ContainerStarted","Data":"55da8baeb298b508d0a988e4af43f10337c6cc62119e9bfa40df809d56025b81"}
Aug 04 15:39:15.648907 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.648899    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:15.667726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.667687    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" podStartSLOduration=1.667675756 podStartE2EDuration="1.667675756s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:15.666655769 +0000 UTC m=+1948.498623890" watchObservedRunningTime="2026-08-04 15:39:15.667675756 +0000 UTC m=+1948.499643872"
Aug 04 15:39:15.693861 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.693817    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" podStartSLOduration=2.247552527 podStartE2EDuration="2.693798354s" totalImagesPullingTime="446.245827ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:15.691114473 +0000 UTC m=+1948.523082590" watchObservedRunningTime="2026-08-04 15:39:15.693798354 +0000 UTC m=+1948.525766472"
Aug 04 15:39:15.710342 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:15.710240    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" podStartSLOduration=1.710229647 podStartE2EDuration="1.710229647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:15.708624786 +0000 UTC m=+1948.540592903" watchObservedRunningTime="2026-08-04 15:39:15.710229647 +0000 UTC m=+1948.542197763"
Aug 04 15:39:21.660930 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:21.660894    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:26.657101 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:26.657063    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:26.657602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:26.657157    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:44.719660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.719572    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:44.720198 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.719844    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" podUID="a9195d6d-55e8-488e-90a3-d97a627cbf76" containerName="maas-api" containerID="cri-o://a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133" gracePeriod=30
Aug 04 15:39:44.768330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.768305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:44.802681 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.802651    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:44.802896 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.802872    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" podUID="e052ee2d-16c0-4736-acff-bf6e11cad592" containerName="payload-processing" containerID="cri-o://8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a" gracePeriod=30
Aug 04 15:39:44.822167 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.822138    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:44.822482 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.822414    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" podUID="213c5b21-db9e-4cae-bc1a-2341f7669086" containerName="payload-pre-processing" containerID="cri-o://0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b" gracePeriod=30
Aug 04 15:39:44.874643 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.874605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:44.982373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:44.981694    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:45.061918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.061894    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:45.085523 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.085501    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:45.090746 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.090719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:45.119081 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.119061    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:45.212729 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212705    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zk6wl\" (UniqueName: \"kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl\") pod \"a9195d6d-55e8-488e-90a3-d97a627cbf76\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") "
Aug 04 15:39:45.212833 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212744    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls\") pod \"a9195d6d-55e8-488e-90a3-d97a627cbf76\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") "
Aug 04 15:39:45.212833 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212789    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hcb7x\" (UniqueName: \"kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x\") pod \"213c5b21-db9e-4cae-bc1a-2341f7669086\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") "
Aug 04 15:39:45.212943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212852    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca\") pod \"a9195d6d-55e8-488e-90a3-d97a627cbf76\" (UID: \"a9195d6d-55e8-488e-90a3-d97a627cbf76\") "
Aug 04 15:39:45.212943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212868    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7r5z2\" (UniqueName: \"kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2\") pod \"e052ee2d-16c0-4736-acff-bf6e11cad592\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") "
Aug 04 15:39:45.212943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212899    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume\") pod \"e052ee2d-16c0-4736-acff-bf6e11cad592\" (UID: \"e052ee2d-16c0-4736-acff-bf6e11cad592\") "
Aug 04 15:39:45.212943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.212935    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume\") pod \"213c5b21-db9e-4cae-bc1a-2341f7669086\" (UID: \"213c5b21-db9e-4cae-bc1a-2341f7669086\") "
Aug 04 15:39:45.213227 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.213200    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a9195d6d-55e8-488e-90a3-d97a627cbf76" (UID: "a9195d6d-55e8-488e-90a3-d97a627cbf76"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:45.213409 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.213384    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9195d6d-55e8-488e-90a3-d97a627cbf76-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.213562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.213525    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e052ee2d-16c0-4736-acff-bf6e11cad592" (UID: "e052ee2d-16c0-4736-acff-bf6e11cad592"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:45.213624 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.213601    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "213c5b21-db9e-4cae-bc1a-2341f7669086" (UID: "213c5b21-db9e-4cae-bc1a-2341f7669086"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:39:45.214908 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.214882    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x" (OuterVolumeSpecName: "kube-api-access-hcb7x") pod "213c5b21-db9e-4cae-bc1a-2341f7669086" (UID: "213c5b21-db9e-4cae-bc1a-2341f7669086"). InnerVolumeSpecName "kube-api-access-hcb7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:45.215043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.215012    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2" (OuterVolumeSpecName: "kube-api-access-7r5z2") pod "e052ee2d-16c0-4736-acff-bf6e11cad592" (UID: "e052ee2d-16c0-4736-acff-bf6e11cad592"). InnerVolumeSpecName "kube-api-access-7r5z2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:45.215305 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.215271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl" (OuterVolumeSpecName: "kube-api-access-zk6wl") pod "a9195d6d-55e8-488e-90a3-d97a627cbf76" (UID: "a9195d6d-55e8-488e-90a3-d97a627cbf76"). InnerVolumeSpecName "kube-api-access-zk6wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:39:45.215381 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.215278    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a9195d6d-55e8-488e-90a3-d97a627cbf76" (UID: "a9195d6d-55e8-488e-90a3-d97a627cbf76"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314056    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zk6wl\" (UniqueName: \"kubernetes.io/projected/a9195d6d-55e8-488e-90a3-d97a627cbf76-kube-api-access-zk6wl\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314081    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9195d6d-55e8-488e-90a3-d97a627cbf76-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314090    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hcb7x\" (UniqueName: \"kubernetes.io/projected/213c5b21-db9e-4cae-bc1a-2341f7669086-kube-api-access-hcb7x\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314100    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7r5z2\" (UniqueName: \"kubernetes.io/projected/e052ee2d-16c0-4736-acff-bf6e11cad592-kube-api-access-7r5z2\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314108    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e052ee2d-16c0-4736-acff-bf6e11cad592-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.314113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.314116    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/213c5b21-db9e-4cae-bc1a-2341f7669086-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:39:45.811715 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.811686    2571 generic.go:356] "Generic (PLEG): container finished" podID="a9195d6d-55e8-488e-90a3-d97a627cbf76" containerID="a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133" exitCode=0
Aug 04 15:39:45.812083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.811727    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"
Aug 04 15:39:45.812083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.811765    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" event={"ID":"a9195d6d-55e8-488e-90a3-d97a627cbf76","Type":"ContainerDied","Data":"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"}
Aug 04 15:39:45.812083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.811830    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd" event={"ID":"a9195d6d-55e8-488e-90a3-d97a627cbf76","Type":"ContainerDied","Data":"57f6776998162613fb4e05ca45eccee7ef1828dcc422b6b68bdeded0e246d1a1"}
Aug 04 15:39:45.812083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.811865    2571 scope.go:117] "RemoveContainer" containerID="a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"
Aug 04 15:39:45.813334 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.813314    2571 generic.go:356] "Generic (PLEG): container finished" podID="e052ee2d-16c0-4736-acff-bf6e11cad592" containerID="8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a" exitCode=0
Aug 04 15:39:45.813428 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.813376    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"
Aug 04 15:39:45.813428 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.813406    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" event={"ID":"e052ee2d-16c0-4736-acff-bf6e11cad592","Type":"ContainerDied","Data":"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"}
Aug 04 15:39:45.813606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.813455    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf" event={"ID":"e052ee2d-16c0-4736-acff-bf6e11cad592","Type":"ContainerDied","Data":"55da8baeb298b508d0a988e4af43f10337c6cc62119e9bfa40df809d56025b81"}
Aug 04 15:39:45.815841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.815772    2571 generic.go:356] "Generic (PLEG): container finished" podID="213c5b21-db9e-4cae-bc1a-2341f7669086" containerID="0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b" exitCode=0
Aug 04 15:39:45.815841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.815827    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"
Aug 04 15:39:45.815841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.815834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" event={"ID":"213c5b21-db9e-4cae-bc1a-2341f7669086","Type":"ContainerDied","Data":"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"}
Aug 04 15:39:45.816099 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.815872    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f" event={"ID":"213c5b21-db9e-4cae-bc1a-2341f7669086","Type":"ContainerDied","Data":"484e4f31267bc1998dc87cb7c4faaf20aa513a7c7d12cc8f80580e5442447c4b"}
Aug 04 15:39:45.822806 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.822788    2571 scope.go:117] "RemoveContainer" containerID="a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"
Aug 04 15:39:45.823076 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:45.823052    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133\": container with ID starting with a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133 not found: ID does not exist" containerID="a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"
Aug 04 15:39:45.823151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.823115    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133"} err="failed to get container status \"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133\": rpc error: code = NotFound desc = could not find container \"a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133\": container with ID starting with a63867b812d5034c990c9ffe3cf7f66e7ec17918e35625ad14318fbe88747133 not found: ID does not exist"
Aug 04 15:39:45.823151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.823137    2571 scope.go:117] "RemoveContainer" containerID="8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"
Aug 04 15:39:45.831054 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.831032    2571 scope.go:117] "RemoveContainer" containerID="8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"
Aug 04 15:39:45.831390 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:45.831359    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a\": container with ID starting with 8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a not found: ID does not exist" containerID="8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"
Aug 04 15:39:45.831498 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.831395    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a"} err="failed to get container status \"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a\": rpc error: code = NotFound desc = could not find container \"8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a\": container with ID starting with 8f4f0553bea13c58da3cfb09160d32fb3b798a6ed3ab76a38620f1ebaf41402a not found: ID does not exist"
Aug 04 15:39:45.831498 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.831412    2571 scope.go:117] "RemoveContainer" containerID="0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"
Aug 04 15:39:45.838933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.838910    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:45.840300 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.840269    2571 scope.go:117] "RemoveContainer" containerID="0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"
Aug 04 15:39:45.840565 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:45.840539    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b\": container with ID starting with 0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b not found: ID does not exist" containerID="0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"
Aug 04 15:39:45.840664 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.840569    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b"} err="failed to get container status \"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b\": rpc error: code = NotFound desc = could not find container \"0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b\": container with ID starting with 0acb9435e245beafd5b38843aba239b30ca394ccca162e414b8c9a2808b6de5b not found: ID does not exist"
Aug 04 15:39:45.846646 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.846627    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8202ac71-8c95cbbc6-h22hd"]
Aug 04 15:39:45.874008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.873985    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:45.883100 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.883071    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8202ac71-fdcb4b764-n8wmf"]
Aug 04 15:39:45.903036 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.903014    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:45.905844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:45.905827    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8202ac71-7477684b56-2lz5f"]
Aug 04 15:39:46.368124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:46.368091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:46.571703 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:46.571672    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:46.816086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:46.816030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:47.291698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:47.291669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:47.716774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:47.716743    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:47.723889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:47.723860    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="213c5b21-db9e-4cae-bc1a-2341f7669086" path="/var/lib/kubelet/pods/213c5b21-db9e-4cae-bc1a-2341f7669086/volumes"
Aug 04 15:39:47.724281 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:47.724267    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9195d6d-55e8-488e-90a3-d97a627cbf76" path="/var/lib/kubelet/pods/a9195d6d-55e8-488e-90a3-d97a627cbf76/volumes"
Aug 04 15:39:47.724617 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:47.724603    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e052ee2d-16c0-4736-acff-bf6e11cad592" path="/var/lib/kubelet/pods/e052ee2d-16c0-4736-acff-bf6e11cad592/volumes"
Aug 04 15:39:50.193586 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:50.193554    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:51.420113 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420078    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:39:51.420537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420523    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9195d6d-55e8-488e-90a3-d97a627cbf76" containerName="maas-api"
Aug 04 15:39:51.420537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420539    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9195d6d-55e8-488e-90a3-d97a627cbf76" containerName="maas-api"
Aug 04 15:39:51.420613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420563    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e052ee2d-16c0-4736-acff-bf6e11cad592" containerName="payload-processing"
Aug 04 15:39:51.420613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420569    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e052ee2d-16c0-4736-acff-bf6e11cad592" containerName="payload-processing"
Aug 04 15:39:51.420613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420590    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="213c5b21-db9e-4cae-bc1a-2341f7669086" containerName="payload-pre-processing"
Aug 04 15:39:51.420613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420597    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="213c5b21-db9e-4cae-bc1a-2341f7669086" containerName="payload-pre-processing"
Aug 04 15:39:51.420735 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420657    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9195d6d-55e8-488e-90a3-d97a627cbf76" containerName="maas-api"
Aug 04 15:39:51.420735 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420668    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e052ee2d-16c0-4736-acff-bf6e11cad592" containerName="payload-processing"
Aug 04 15:39:51.420735 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.420677    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="213c5b21-db9e-4cae-bc1a-2341f7669086" containerName="payload-pre-processing"
Aug 04 15:39:51.423725 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.423709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.427228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.427207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-0f33af57-serving-cert\""
Aug 04 15:39:51.449118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.449096    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:39:51.566546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.566521    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.566685 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.566571    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.566685 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.566643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w5s2\" (UniqueName: \"kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.570598 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.570572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:51.667324 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.667283    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w5s2\" (UniqueName: \"kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.667423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.667344    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.667423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.667380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.667500 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:51.667479    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-serving-cert: secret "maas-api-e2e-derive-0f33af57-serving-cert" not found
Aug 04 15:39:51.667534 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:39:51.667529    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls podName:68a4c2c8-6a5b-47e4-9978-d47f42e9cde0 nodeName:}" failed. No retries permitted until 2026-08-04 15:39:52.167515036 +0000 UTC m=+1984.999483132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls") pod "maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" (UID: "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0") : secret "maas-api-e2e-derive-0f33af57-serving-cert" not found
Aug 04 15:39:51.667959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.667915    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.680286 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.680238    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w5s2\" (UniqueName: \"kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:51.719901 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.719877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:51.983204 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:51.983138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:52.118955 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.118923    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:52.172480 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.172455    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:52.174814 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.174786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") pod \"maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:52.231505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.231483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:39:52.307505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.307447    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:39:52.311104 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.311090    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.315648 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.315629    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-0f33af57-dockercfg-49z76\""
Aug 04 15:39:52.315754 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.315705    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-0f33af57\""
Aug 04 15:39:52.334098 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.334065    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:39:52.334204 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.334159    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:52.399454 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.399418    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:39:52.418076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.417027    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.418076 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.417959    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:39:52.474971 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.474943    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.475327 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.475044    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.515154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.515133    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:39:52.515820 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:52.515786    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68a4c2c8_6a5b_47e4_9978_d47f42e9cde0.slice/crio-87128c72e2bd310a524bd9a74593be3141d1d17a5241c69fd55d7d1e526afafd WatchSource:0}: Error finding container 87128c72e2bd310a524bd9a74593be3141d1d17a5241c69fd55d7d1e526afafd: Status 404 returned error can't find the container with id 87128c72e2bd310a524bd9a74593be3141d1d17a5241c69fd55d7d1e526afafd
Aug 04 15:39:52.575904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.575848    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.575904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.575893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.576034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.575916    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxk48\" (UniqueName: \"kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.576034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.575996    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.576718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.576701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.587323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.587302    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q\") pod \"payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.621998 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.621975    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:52.676845 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.676808    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.676973 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.676865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxk48\" (UniqueName: \"kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.679143 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.679114    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.692238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.692211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxk48\" (UniqueName: \"kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48\") pod \"payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") " pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.733971 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.733947    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:52.856479 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.856401    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" event={"ID":"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0","Type":"ContainerStarted","Data":"87128c72e2bd310a524bd9a74593be3141d1d17a5241c69fd55d7d1e526afafd"}
Aug 04 15:39:52.963918 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:52.963885    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:39:52.964901 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:52.964875    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40ed9918_d551_4a8c_8011_55e7c8ecc779.slice/crio-6ce846caa51cab8c57515cab908fbf6a8dfe848a308b8a6f4aae10f3354d6c21 WatchSource:0}: Error finding container 6ce846caa51cab8c57515cab908fbf6a8dfe848a308b8a6f4aae10f3354d6c21: Status 404 returned error can't find the container with id 6ce846caa51cab8c57515cab908fbf6a8dfe848a308b8a6f4aae10f3354d6c21
Aug 04 15:39:53.087425 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.087402    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:39:53.089314 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:39:53.089275    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9943e7bb_ee7e_4d2d_bd59_7db728f1322f.slice/crio-4024e021ae29dcfe6e777a12fdfd5d0c9b2209eaf19ac20cbb1f9db873556117 WatchSource:0}: Error finding container 4024e021ae29dcfe6e777a12fdfd5d0c9b2209eaf19ac20cbb1f9db873556117: Status 404 returned error can't find the container with id 4024e021ae29dcfe6e777a12fdfd5d0c9b2209eaf19ac20cbb1f9db873556117
Aug 04 15:39:53.863825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.863787    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" event={"ID":"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0","Type":"ContainerStarted","Data":"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"}
Aug 04 15:39:53.864335 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.863855    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:39:53.865602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.865568    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" event={"ID":"9943e7bb-ee7e-4d2d-bd59-7db728f1322f","Type":"ContainerStarted","Data":"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"}
Aug 04 15:39:53.865717 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.865627    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" event={"ID":"9943e7bb-ee7e-4d2d-bd59-7db728f1322f","Type":"ContainerStarted","Data":"4024e021ae29dcfe6e777a12fdfd5d0c9b2209eaf19ac20cbb1f9db873556117"}
Aug 04 15:39:53.865717 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.865659    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:39:53.867334 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.867314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" event={"ID":"40ed9918-d551-4a8c-8011-55e7c8ecc779","Type":"ContainerStarted","Data":"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"}
Aug 04 15:39:53.867430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.867357    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:39:53.867430 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.867375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" event={"ID":"40ed9918-d551-4a8c-8011-55e7c8ecc779","Type":"ContainerStarted","Data":"6ce846caa51cab8c57515cab908fbf6a8dfe848a308b8a6f4aae10f3354d6c21"}
Aug 04 15:39:53.904603 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.904559    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" podStartSLOduration=2.546943436 podStartE2EDuration="2.904544862s" totalImagesPullingTime="357.601426ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:53.903607029 +0000 UTC m=+1986.735575168" watchObservedRunningTime="2026-08-04 15:39:53.904544862 +0000 UTC m=+1986.736512978"
Aug 04 15:39:53.927993 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.927954    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" podStartSLOduration=1.9279414080000001 podStartE2EDuration="1.927941408s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:53.926381042 +0000 UTC m=+1986.758349156" watchObservedRunningTime="2026-08-04 15:39:53.927941408 +0000 UTC m=+1986.759909516"
Aug 04 15:39:53.959838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:53.959795    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" podStartSLOduration=1.9597836100000001 podStartE2EDuration="1.95978361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:39:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:39:53.958172164 +0000 UTC m=+1986.790140281" watchObservedRunningTime="2026-08-04 15:39:53.95978361 +0000 UTC m=+1986.791751726"
Aug 04 15:39:59.877524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:39:59.877491    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:40:04.875067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:04.875033    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:40:04.875531 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:04.875098    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:40:22.039632 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.039602    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:40:22.040118 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.039783    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" podUID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" containerName="maas-api" containerID="cri-o://9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f" gracePeriod=30
Aug 04 15:40:22.081780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.081753    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:22.118452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.118420    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:40:22.118670 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.118648    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" podUID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" containerName="payload-processing" containerID="cri-o://49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36" gracePeriod=30
Aug 04 15:40:22.127037 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.127010    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:40:22.127399 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.127315    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" podUID="40ed9918-d551-4a8c-8011-55e7c8ecc779" containerName="payload-pre-processing" containerID="cri-o://856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6" gracePeriod=30
Aug 04 15:40:22.186805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.186772    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:22.284619 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.284499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:22.403073 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.403050    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:40:22.406255 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.406226    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:40:22.418526 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.418509    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:40:22.519403 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519375    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca\") pod \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") "
Aug 04 15:40:22.519568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519415    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") pod \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") "
Aug 04 15:40:22.519568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519444    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxk48\" (UniqueName: \"kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48\") pod \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") "
Aug 04 15:40:22.519568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519465    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume\") pod \"40ed9918-d551-4a8c-8011-55e7c8ecc779\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") "
Aug 04 15:40:22.519568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519521    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume\") pod \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\" (UID: \"9943e7bb-ee7e-4d2d-bd59-7db728f1322f\") "
Aug 04 15:40:22.519568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519546    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w5s2\" (UniqueName: \"kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2\") pod \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\" (UID: \"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0\") "
Aug 04 15:40:22.519844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519587    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q\") pod \"40ed9918-d551-4a8c-8011-55e7c8ecc779\" (UID: \"40ed9918-d551-4a8c-8011-55e7c8ecc779\") "
Aug 04 15:40:22.519844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519821    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" (UID: "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:40:22.519964 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519870    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "40ed9918-d551-4a8c-8011-55e7c8ecc779" (UID: "40ed9918-d551-4a8c-8011-55e7c8ecc779"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:40:22.519964 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519910    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9943e7bb-ee7e-4d2d-bd59-7db728f1322f" (UID: "9943e7bb-ee7e-4d2d-bd59-7db728f1322f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:40:22.520079 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.519988    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.520079 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.520009    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/40ed9918-d551-4a8c-8011-55e7c8ecc779-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.521771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.521743    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48" (OuterVolumeSpecName: "kube-api-access-gxk48") pod "9943e7bb-ee7e-4d2d-bd59-7db728f1322f" (UID: "9943e7bb-ee7e-4d2d-bd59-7db728f1322f"). InnerVolumeSpecName "kube-api-access-gxk48". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:40:22.521933 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.521814    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q" (OuterVolumeSpecName: "kube-api-access-khp8q") pod "40ed9918-d551-4a8c-8011-55e7c8ecc779" (UID: "40ed9918-d551-4a8c-8011-55e7c8ecc779"). InnerVolumeSpecName "kube-api-access-khp8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:40:22.522063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.522037    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2" (OuterVolumeSpecName: "kube-api-access-5w5s2") pod "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" (UID: "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0"). InnerVolumeSpecName "kube-api-access-5w5s2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:40:22.522115 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.522069    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" (UID: "68a4c2c8-6a5b-47e4-9978-d47f42e9cde0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:40:22.536635 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.536550    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:22.620859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.620792    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khp8q\" (UniqueName: \"kubernetes.io/projected/40ed9918-d551-4a8c-8011-55e7c8ecc779-kube-api-access-khp8q\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.620859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.620817    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.620859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.620827    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxk48\" (UniqueName: \"kubernetes.io/projected/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-kube-api-access-gxk48\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.620859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.620838    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9943e7bb-ee7e-4d2d-bd59-7db728f1322f-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.620859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.620846    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w5s2\" (UniqueName: \"kubernetes.io/projected/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0-kube-api-access-5w5s2\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:40:22.652737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.652708    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:22.801434 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:22.801408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:23.018798 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.018765    2571 generic.go:356] "Generic (PLEG): container finished" podID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" containerID="9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f" exitCode=0
Aug 04 15:40:23.018923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.018813    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"
Aug 04 15:40:23.018923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.018811    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" event={"ID":"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0","Type":"ContainerDied","Data":"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"}
Aug 04 15:40:23.018923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.018864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq" event={"ID":"68a4c2c8-6a5b-47e4-9978-d47f42e9cde0","Type":"ContainerDied","Data":"87128c72e2bd310a524bd9a74593be3141d1d17a5241c69fd55d7d1e526afafd"}
Aug 04 15:40:23.018923 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.018887    2571 scope.go:117] "RemoveContainer" containerID="9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"
Aug 04 15:40:23.020377 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.020349    2571 generic.go:356] "Generic (PLEG): container finished" podID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" containerID="49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36" exitCode=0
Aug 04 15:40:23.020478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.020383    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"
Aug 04 15:40:23.020478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.020435    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" event={"ID":"9943e7bb-ee7e-4d2d-bd59-7db728f1322f","Type":"ContainerDied","Data":"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"}
Aug 04 15:40:23.020607 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.020478    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w" event={"ID":"9943e7bb-ee7e-4d2d-bd59-7db728f1322f","Type":"ContainerDied","Data":"4024e021ae29dcfe6e777a12fdfd5d0c9b2209eaf19ac20cbb1f9db873556117"}
Aug 04 15:40:23.022169 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.022139    2571 generic.go:356] "Generic (PLEG): container finished" podID="40ed9918-d551-4a8c-8011-55e7c8ecc779" containerID="856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6" exitCode=0
Aug 04 15:40:23.022309 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.022178    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" event={"ID":"40ed9918-d551-4a8c-8011-55e7c8ecc779","Type":"ContainerDied","Data":"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"}
Aug 04 15:40:23.022309 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.022185    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"
Aug 04 15:40:23.022309 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.022220    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b" event={"ID":"40ed9918-d551-4a8c-8011-55e7c8ecc779","Type":"ContainerDied","Data":"6ce846caa51cab8c57515cab908fbf6a8dfe848a308b8a6f4aae10f3354d6c21"}
Aug 04 15:40:23.030451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.030421    2571 scope.go:117] "RemoveContainer" containerID="9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"
Aug 04 15:40:23.030754 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:40:23.030729    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f\": container with ID starting with 9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f not found: ID does not exist" containerID="9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"
Aug 04 15:40:23.030850 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.030766    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f"} err="failed to get container status \"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f\": rpc error: code = NotFound desc = could not find container \"9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f\": container with ID starting with 9996d19315b070f093bb5db1e1b37367399eadfdf43ab7b3d366a6a7f366c93f not found: ID does not exist"
Aug 04 15:40:23.030850 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.030787    2571 scope.go:117] "RemoveContainer" containerID="49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"
Aug 04 15:40:23.039689 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.039671    2571 scope.go:117] "RemoveContainer" containerID="49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"
Aug 04 15:40:23.039937 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:40:23.039918    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36\": container with ID starting with 49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36 not found: ID does not exist" containerID="49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"
Aug 04 15:40:23.039978 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.039943    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36"} err="failed to get container status \"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36\": rpc error: code = NotFound desc = could not find container \"49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36\": container with ID starting with 49a625594d050a5626cc4dcb7172700ac914c48dfe3310f2b2f512dffdee2a36 not found: ID does not exist"
Aug 04 15:40:23.039978 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.039958    2571 scope.go:117] "RemoveContainer" containerID="856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"
Aug 04 15:40:23.050692 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.050672    2571 scope.go:117] "RemoveContainer" containerID="856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"
Aug 04 15:40:23.050971 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:40:23.050952    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6\": container with ID starting with 856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6 not found: ID does not exist" containerID="856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"
Aug 04 15:40:23.051020 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.050976    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6"} err="failed to get container status \"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6\": rpc error: code = NotFound desc = could not find container \"856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6\": container with ID starting with 856b6be21faf0ccb06c34dd85591ec6b0434c2b52c35b16b0edc493e800a76c6 not found: ID does not exist"
Aug 04 15:40:23.059811 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.059788    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:40:23.063163 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.063144    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-0f33af57-7f56c87f6d-mrb5b"]
Aug 04 15:40:23.079658 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.079636    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:40:23.085675 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.085655    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-0f33af57-b54f6bb9d-s65wq"]
Aug 04 15:40:23.114540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.113110    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:40:23.117863 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.117842    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-0f33af57-58fcc7b886-nml8w"]
Aug 04 15:40:23.339531 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.339453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:23.459162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.459132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:23.724861 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.724833    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40ed9918-d551-4a8c-8011-55e7c8ecc779" path="/var/lib/kubelet/pods/40ed9918-d551-4a8c-8011-55e7c8ecc779/volumes"
Aug 04 15:40:23.725216 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.725202    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" path="/var/lib/kubelet/pods/68a4c2c8-6a5b-47e4-9978-d47f42e9cde0/volumes"
Aug 04 15:40:23.725569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:23.725556    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" path="/var/lib/kubelet/pods/9943e7bb-ee7e-4d2d-bd59-7db728f1322f/volumes"
Aug 04 15:40:45.658351 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:45.658311    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:55.109943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:55.109905    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:55.294051 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:55.294020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:55.441216 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:55.441170    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:55.592756 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:55.592699    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:40:56.008317 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:40:56.008264    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:21.967278 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:21.967190    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:29.682737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:29.682704    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:29.839761 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:29.839730    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:31.046525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:31.046492    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:45.822072 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:45.822032    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:52.165810 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:52.165753    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:52.405091 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:52.405054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:52.501595 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:52.501502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:41:59.207566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:41:59.207527    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:02.945591 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:02.945547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:03.325082 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:03.324989    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:03.387904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:03.387876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:14.084457 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:14.084417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:20.474012 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:20.473977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:21.161969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:21.161941    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:21.264181 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:21.264156    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:21.508429 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:21.508364    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:21.615406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:21.615376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:21.723401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:21.723373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:23.264910 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:23.264874    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:29.153004 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:29.152965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:29.225478 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:29.225448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:29.848039 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:29.848006    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:31.626214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:31.626179    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:37.146458 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:37.146419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:37.258605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:37.258566    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:37.471771 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:37.471684    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:37.845926 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:37.845844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:38.188497 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:38.188450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:40.817319 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:40.817213    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:40.924136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:40.924101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:41.913504 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913472    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:42:41.913901 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913889    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40ed9918-d551-4a8c-8011-55e7c8ecc779" containerName="payload-pre-processing"
Aug 04 15:42:41.913901 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913900    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="40ed9918-d551-4a8c-8011-55e7c8ecc779" containerName="payload-pre-processing"
Aug 04 15:42:41.913992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913913    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" containerName="maas-api"
Aug 04 15:42:41.913992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913919    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" containerName="maas-api"
Aug 04 15:42:41.913992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913933    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" containerName="payload-processing"
Aug 04 15:42:41.913992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913939    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" containerName="payload-processing"
Aug 04 15:42:41.914134 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.913996    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="68a4c2c8-6a5b-47e4-9978-d47f42e9cde0" containerName="maas-api"
Aug 04 15:42:41.914134 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.914005    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="9943e7bb-ee7e-4d2d-bd59-7db728f1322f" containerName="payload-processing"
Aug 04 15:42:41.914134 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.914012    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="40ed9918-d551-4a8c-8011-55e7c8ecc779" containerName="payload-pre-processing"
Aug 04 15:42:41.917193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.917173    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:41.920410 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.920381    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-96b2e1f8-serving-cert\""
Aug 04 15:42:41.930102 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.930073    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:42:41.954773 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:41.954742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:42.025929 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.025883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4hqk\" (UniqueName: \"kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.025929 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.025931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.026184 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.025988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.126755 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.126713    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4hqk\" (UniqueName: \"kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.126954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.126830    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.126954 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.126896    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.126954 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:42:42.126927    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-serving-cert: secret "maas-api-e2e-mt-96b2e1f8-serving-cert" not found
Aug 04 15:42:42.127145 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:42:42.127006    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls podName:f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a nodeName:}" failed. No retries permitted until 2026-08-04 15:42:42.626984274 +0000 UTC m=+2155.458952389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls") pod "maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" (UID: "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a") : secret "maas-api-e2e-mt-96b2e1f8-serving-cert" not found
Aug 04 15:42:42.127880 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.127855    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.142971 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.142938    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4hqk\" (UniqueName: \"kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.187679 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.187594    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:42.523827 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.523713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:42.624243 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.624205    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:42:42.631381 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.631346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.633820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.633799    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") pod \"maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.726724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.726687    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:42:42.730505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.730485    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.734320 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.734283    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-96b2e1f8-dockercfg-rklqq\""
Aug 04 15:42:42.735325 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.735279    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-96b2e1f8\""
Aug 04 15:42:42.742663 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.742634    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:42:42.787616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.787523    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:42:42.791114 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.791088    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:42.813593 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.813560    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:42:42.829408 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.829370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:42.833726 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.833699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtf84\" (UniqueName: \"kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.833906 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.833880    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.935046 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.934988    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:42.935495 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.935195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9b2d\" (UniqueName: \"kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:42.935495 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.935332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.935495 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.935441    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtf84\" (UniqueName: \"kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.936247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.936216    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.945708 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.945684    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtf84\" (UniqueName: \"kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84\") pod \"payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:42.985714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:42.985688    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:42:42.988214 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:42:42.988186    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5b7d7e7_53d1_4f24_a1e1_d63eb7effc7a.slice/crio-05fdfa15aaa50114649243b62c2d4d856d9b12986a02235875d32c13cab576b3 WatchSource:0}: Error finding container 05fdfa15aaa50114649243b62c2d4d856d9b12986a02235875d32c13cab576b3: Status 404 returned error can't find the container with id 05fdfa15aaa50114649243b62c2d4d856d9b12986a02235875d32c13cab576b3
Aug 04 15:42:43.036357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.036320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.036526 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.036386    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9b2d\" (UniqueName: \"kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.037032 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.037013    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.043089 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.043017    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:43.045642 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.045610    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9b2d\" (UniqueName: \"kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d\") pod \"payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") " pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.102116 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.102089    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.195800 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.195771    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:42:43.197590 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:42:43.197561    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod704c7d9e_ef21_4e69_bce2_b4da9da3dd93.slice/crio-1c4ba62a76b71e327c4e723e93653e241ca3f05b0f9809acf0b67efdba8e679e WatchSource:0}: Error finding container 1c4ba62a76b71e327c4e723e93653e241ca3f05b0f9809acf0b67efdba8e679e: Status 404 returned error can't find the container with id 1c4ba62a76b71e327c4e723e93653e241ca3f05b0f9809acf0b67efdba8e679e
Aug 04 15:42:43.269736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.269697    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:42:43.270323 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:42:43.270270    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f9049d5_59b4_4997_9a55_4554b97b4be3.slice/crio-a2f09980023ea97c4c1c43e3f23d5b4bad3d8a0bf07fb3448b2fbdf7fbcf93fd WatchSource:0}: Error finding container a2f09980023ea97c4c1c43e3f23d5b4bad3d8a0bf07fb3448b2fbdf7fbcf93fd: Status 404 returned error can't find the container with id a2f09980023ea97c4c1c43e3f23d5b4bad3d8a0bf07fb3448b2fbdf7fbcf93fd
Aug 04 15:42:43.760995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.760958    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" event={"ID":"6f9049d5-59b4-4997-9a55-4554b97b4be3","Type":"ContainerStarted","Data":"da39083013da20ba53bd8b62c155b8547b56cd82db526a737d571970ceefbad0"}
Aug 04 15:42:43.761191 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.761016    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" event={"ID":"6f9049d5-59b4-4997-9a55-4554b97b4be3","Type":"ContainerStarted","Data":"a2f09980023ea97c4c1c43e3f23d5b4bad3d8a0bf07fb3448b2fbdf7fbcf93fd"}
Aug 04 15:42:43.761191 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.761050    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:42:43.762529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.762501    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" event={"ID":"704c7d9e-ef21-4e69-bce2-b4da9da3dd93","Type":"ContainerStarted","Data":"3a4a91d0b7e27535ad3632ba4551f162b29ff355b391ac769b08f77450d090ea"}
Aug 04 15:42:43.762660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.762554    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" event={"ID":"704c7d9e-ef21-4e69-bce2-b4da9da3dd93","Type":"ContainerStarted","Data":"1c4ba62a76b71e327c4e723e93653e241ca3f05b0f9809acf0b67efdba8e679e"}
Aug 04 15:42:43.762660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.762586    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:43.763730 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.763709    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" event={"ID":"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a","Type":"ContainerStarted","Data":"05fdfa15aaa50114649243b62c2d4d856d9b12986a02235875d32c13cab576b3"}
Aug 04 15:42:43.790051 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.790008    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" podStartSLOduration=1.7899953530000001 podStartE2EDuration="1.789995353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:43.788230897 +0000 UTC m=+2156.620199014" watchObservedRunningTime="2026-08-04 15:42:43.789995353 +0000 UTC m=+2156.621963469"
Aug 04 15:42:43.810534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:43.810487    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" podStartSLOduration=1.810473439 podStartE2EDuration="1.810473439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:43.808787921 +0000 UTC m=+2156.640756041" watchObservedRunningTime="2026-08-04 15:42:43.810473439 +0000 UTC m=+2156.642441558"
Aug 04 15:42:44.772501 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:44.772452    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" event={"ID":"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a","Type":"ContainerStarted","Data":"d8de0e314b3aaf865307a819d6f809cf0151f906bf016ac3ed35ea5a4da89c42"}
Aug 04 15:42:44.793651 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:44.793602    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" podStartSLOduration=2.225242123 podStartE2EDuration="3.79358681s" totalImagesPullingTime="1.568344687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:42:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:42:44.793286955 +0000 UTC m=+2157.625255072" watchObservedRunningTime="2026-08-04 15:42:44.79358681 +0000 UTC m=+2157.625554928"
Aug 04 15:42:45.778124 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:45.778096    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:51.788063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:51.788029    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:42:54.774265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:54.774234    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:42:54.774756 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:42:54.774342    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:43:05.763449 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:05.763413    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:06.546352 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:06.546320    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:06.641054 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:06.641021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:06.986422 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:06.986391    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:12.854025 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:12.853986    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:12.953942 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:12.953911    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:23.725534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.725505    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:43:23.725997 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.725696    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" podUID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" containerName="maas-api" containerID="cri-o://d8de0e314b3aaf865307a819d6f809cf0151f906bf016ac3ed35ea5a4da89c42" gracePeriod=30
Aug 04 15:43:23.759100 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.759068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:23.780805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.780780    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:43:23.780987 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.780961    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" podUID="6f9049d5-59b4-4997-9a55-4554b97b4be3" containerName="payload-processing" containerID="cri-o://da39083013da20ba53bd8b62c155b8547b56cd82db526a737d571970ceefbad0" gracePeriod=30
Aug 04 15:43:23.789362 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.789314    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:43:23.789664 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.789528    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" podUID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" containerName="payload-pre-processing" containerID="cri-o://3a4a91d0b7e27535ad3632ba4551f162b29ff355b391ac769b08f77450d090ea" gracePeriod=30
Aug 04 15:43:23.835245 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.835220    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:23.937406 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.937369    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:23.985441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.984735    2571 generic.go:356] "Generic (PLEG): container finished" podID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" containerID="d8de0e314b3aaf865307a819d6f809cf0151f906bf016ac3ed35ea5a4da89c42" exitCode=0
Aug 04 15:43:23.985441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.984809    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" event={"ID":"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a","Type":"ContainerDied","Data":"d8de0e314b3aaf865307a819d6f809cf0151f906bf016ac3ed35ea5a4da89c42"}
Aug 04 15:43:23.987548 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.987104    2571 generic.go:356] "Generic (PLEG): container finished" podID="6f9049d5-59b4-4997-9a55-4554b97b4be3" containerID="da39083013da20ba53bd8b62c155b8547b56cd82db526a737d571970ceefbad0" exitCode=0
Aug 04 15:43:23.987548 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.987187    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" event={"ID":"6f9049d5-59b4-4997-9a55-4554b97b4be3","Type":"ContainerDied","Data":"da39083013da20ba53bd8b62c155b8547b56cd82db526a737d571970ceefbad0"}
Aug 04 15:43:23.989358 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.989329    2571 generic.go:356] "Generic (PLEG): container finished" podID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" containerID="3a4a91d0b7e27535ad3632ba4551f162b29ff355b391ac769b08f77450d090ea" exitCode=0
Aug 04 15:43:23.989451 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:23.989372    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" event={"ID":"704c7d9e-ef21-4e69-bce2-b4da9da3dd93","Type":"ContainerDied","Data":"3a4a91d0b7e27535ad3632ba4551f162b29ff355b391ac769b08f77450d090ea"}
Aug 04 15:43:24.034334 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.034061    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:24.056531 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.056507    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:43:24.060002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.059978    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:43:24.085219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.085196    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:43:24.102123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102101    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") pod \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") "
Aug 04 15:43:24.102228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102151    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9b2d\" (UniqueName: \"kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d\") pod \"6f9049d5-59b4-4997-9a55-4554b97b4be3\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") "
Aug 04 15:43:24.102228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102207    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca\") pod \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") "
Aug 04 15:43:24.102365 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102247    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume\") pod \"6f9049d5-59b4-4997-9a55-4554b97b4be3\" (UID: \"6f9049d5-59b4-4997-9a55-4554b97b4be3\") "
Aug 04 15:43:24.102419 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102366    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4hqk\" (UniqueName: \"kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk\") pod \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\" (UID: \"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a\") "
Aug 04 15:43:24.102679 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102650    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" (UID: "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:43:24.102793 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.102753    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f9049d5-59b4-4997-9a55-4554b97b4be3" (UID: "6f9049d5-59b4-4997-9a55-4554b97b4be3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:43:24.104502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.104479    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk" (OuterVolumeSpecName: "kube-api-access-d4hqk") pod "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" (UID: "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a"). InnerVolumeSpecName "kube-api-access-d4hqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:43:24.104737 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.104711    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" (UID: "f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:43:24.104815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.104727    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d" (OuterVolumeSpecName: "kube-api-access-v9b2d") pod "6f9049d5-59b4-4997-9a55-4554b97b4be3" (UID: "6f9049d5-59b4-4997-9a55-4554b97b4be3"). InnerVolumeSpecName "kube-api-access-v9b2d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:43:24.203649 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203619    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume\") pod \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") "
Aug 04 15:43:24.203798 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203676    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gtf84\" (UniqueName: \"kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84\") pod \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\" (UID: \"704c7d9e-ef21-4e69-bce2-b4da9da3dd93\") "
Aug 04 15:43:24.203959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203933    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "704c7d9e-ef21-4e69-bce2-b4da9da3dd93" (UID: "704c7d9e-ef21-4e69-bce2-b4da9da3dd93"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:43:24.204016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203947    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.204016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203981    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9b2d\" (UniqueName: \"kubernetes.io/projected/6f9049d5-59b4-4997-9a55-4554b97b4be3-kube-api-access-v9b2d\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.204016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.203992    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.204016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.204002    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f9049d5-59b4-4997-9a55-4554b97b4be3-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.204016 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.204012    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4hqk\" (UniqueName: \"kubernetes.io/projected/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a-kube-api-access-d4hqk\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.205601 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.205581    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84" (OuterVolumeSpecName: "kube-api-access-gtf84") pod "704c7d9e-ef21-4e69-bce2-b4da9da3dd93" (UID: "704c7d9e-ef21-4e69-bce2-b4da9da3dd93"). InnerVolumeSpecName "kube-api-access-gtf84". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:43:24.304674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.304618    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.304674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.304640    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gtf84\" (UniqueName: \"kubernetes.io/projected/704c7d9e-ef21-4e69-bce2-b4da9da3dd93-kube-api-access-gtf84\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:43:24.390938 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.390910    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:24.995067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.995003    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"
Aug 04 15:43:24.995067 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.995022    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz" event={"ID":"f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a","Type":"ContainerDied","Data":"05fdfa15aaa50114649243b62c2d4d856d9b12986a02235875d32c13cab576b3"}
Aug 04 15:43:24.995500 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.995084    2571 scope.go:117] "RemoveContainer" containerID="d8de0e314b3aaf865307a819d6f809cf0151f906bf016ac3ed35ea5a4da89c42"
Aug 04 15:43:24.996699 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.996672    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"
Aug 04 15:43:24.996848 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.996672    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb" event={"ID":"6f9049d5-59b4-4997-9a55-4554b97b4be3","Type":"ContainerDied","Data":"a2f09980023ea97c4c1c43e3f23d5b4bad3d8a0bf07fb3448b2fbdf7fbcf93fd"}
Aug 04 15:43:24.997959 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.997936    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h" event={"ID":"704c7d9e-ef21-4e69-bce2-b4da9da3dd93","Type":"ContainerDied","Data":"1c4ba62a76b71e327c4e723e93653e241ca3f05b0f9809acf0b67efdba8e679e"}
Aug 04 15:43:24.998087 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:24.997946    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"
Aug 04 15:43:25.004393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.004371    2571 scope.go:117] "RemoveContainer" containerID="da39083013da20ba53bd8b62c155b8547b56cd82db526a737d571970ceefbad0"
Aug 04 15:43:25.013758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.013742    2571 scope.go:117] "RemoveContainer" containerID="3a4a91d0b7e27535ad3632ba4551f162b29ff355b391ac769b08f77450d090ea"
Aug 04 15:43:25.023568 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.023536    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:43:25.025507 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.025488    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-96b2e1f8-56cf4b6f9b-2mwlz"]
Aug 04 15:43:25.038839 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.038819    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:43:25.044435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.044412    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-96b2e1f8-75758c7d66-bfrhb"]
Aug 04 15:43:25.055967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.055950    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:43:25.060051 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.060032    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-96b2e1f8-886877dbd-5tt6h"]
Aug 04 15:43:25.723972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.723932    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f9049d5-59b4-4997-9a55-4554b97b4be3" path="/var/lib/kubelet/pods/6f9049d5-59b4-4997-9a55-4554b97b4be3/volumes"
Aug 04 15:43:25.724413 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.724388    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" path="/var/lib/kubelet/pods/704c7d9e-ef21-4e69-bce2-b4da9da3dd93/volumes"
Aug 04 15:43:25.724829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:25.724809    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" path="/var/lib/kubelet/pods/f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a/volumes"
Aug 04 15:43:30.413026 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:30.412997    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:30.484854 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:30.484816    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:32.075356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:32.075323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:32.174472 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:32.174434    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:37.546883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:37.546844    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:37.623276 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:37.623230    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:37.751422 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:37.751393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:37.930380 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:37.930350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:43.921983 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:43.921949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:43:44.020753 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:43:44.020710    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:44:15.293524 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:44:15.293430    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:44:18.461912 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:44:18.461875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:11.568839 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:11.568799    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:46.417888 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:46.417797    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:46.769435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:46.769356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:47.492416 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:47.492380    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:49.652570 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:49.652532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:49.772753 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:49.772726    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:50.842131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842102    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:45:50.842725 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842705    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" containerName="payload-pre-processing"
Aug 04 15:45:50.842809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842727    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" containerName="payload-pre-processing"
Aug 04 15:45:50.842809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842741    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f9049d5-59b4-4997-9a55-4554b97b4be3" containerName="payload-processing"
Aug 04 15:45:50.842809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842748    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f9049d5-59b4-4997-9a55-4554b97b4be3" containerName="payload-processing"
Aug 04 15:45:50.842809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842767    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" containerName="maas-api"
Aug 04 15:45:50.842809 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842778    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" containerName="maas-api"
Aug 04 15:45:50.843053 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842885    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="704c7d9e-ef21-4e69-bce2-b4da9da3dd93" containerName="payload-pre-processing"
Aug 04 15:45:50.843053 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842899    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5b7d7e7-53d1-4f24-a1e1-d63eb7effc7a" containerName="maas-api"
Aug 04 15:45:50.843053 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.842911    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f9049d5-59b4-4997-9a55-4554b97b4be3" containerName="payload-processing"
Aug 04 15:45:50.846233 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.846213    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:50.849509 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.849484    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-01d7a1ad-serving-cert\""
Aug 04 15:45:50.873890 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.873865    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:45:50.890488 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.890456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:50.939191 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.939147    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lzch\" (UniqueName: \"kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:50.939338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.939202    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:50.939338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:50.939278    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.039961 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.039929    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lzch\" (UniqueName: \"kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.040088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.039965    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.040088 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.039986    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.040170 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:45:51.040126    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-serving-cert: secret "maas-api-e2e-mt-01d7a1ad-serving-cert" not found
Aug 04 15:45:51.040205 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:45:51.040185    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls podName:aad702f2-b13e-48b3-a23a-28fdd981d89e nodeName:}" failed. No retries permitted until 2026-08-04 15:45:51.540170009 +0000 UTC m=+2344.372138107 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls") pod "maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" (UID: "aad702f2-b13e-48b3-a23a-28fdd981d89e") : secret "maas-api-e2e-mt-01d7a1ad-serving-cert" not found
Aug 04 15:45:51.040656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.040637    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.048786 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.048760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lzch\" (UniqueName: \"kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.240086 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.240052    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:51.545915 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.545831    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.548543 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.548511    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") pod \"maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.600334 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.600281    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:51.701831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.701794    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:45:51.756958 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.756922    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:51.793216 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.793176    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:45:51.796904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.796836    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.799654 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.799630    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-01d7a1ad\""
Aug 04 15:45:51.799787 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.799718    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-01d7a1ad-dockercfg-6wxwl\""
Aug 04 15:45:51.809871 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.809852    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:45:51.849237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.848978    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.849237 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.849046    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9swd\" (UniqueName: \"kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.878486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.878404    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:45:51.883259 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.883231    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:51.892996 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.892387    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:45:51.906973 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.906937    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:45:51.910139 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:45:51.910102    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad702f2_b13e_48b3_a23a_28fdd981d89e.slice/crio-3b08efdcaca56791817605f5adfa6cd603e8851170b587c85dfdcb0bbdfbb97e WatchSource:0}: Error finding container 3b08efdcaca56791817605f5adfa6cd603e8851170b587c85dfdcb0bbdfbb97e: Status 404 returned error can't find the container with id 3b08efdcaca56791817605f5adfa6cd603e8851170b587c85dfdcb0bbdfbb97e
Aug 04 15:45:51.911598 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.911570    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:45:51.950950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.950919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz7hj\" (UniqueName: \"kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:51.951080 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.951058    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.951160 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.951124    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:51.951219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.951168    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9swd\" (UniqueName: \"kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.951973 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.951949    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:51.960363 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:51.960341    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9swd\" (UniqueName: \"kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd\") pod \"payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:52.052320 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.052219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz7hj\" (UniqueName: \"kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.052479 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.052342    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.053218 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.053194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.061745 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.061720    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz7hj\" (UniqueName: \"kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj\") pod \"payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") " pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.111323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.111274    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:52.197504 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.197472    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.269939 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:45:52.269900    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b6eef0_1876_4f0f_a112_e959e8db3750.slice/crio-d23831032d4e556a4d085970903071ee0afacf947df59587d99088c175c52c46 WatchSource:0}: Error finding container d23831032d4e556a4d085970903071ee0afacf947df59587d99088c175c52c46: Status 404 returned error can't find the container with id d23831032d4e556a4d085970903071ee0afacf947df59587d99088c175c52c46
Aug 04 15:45:52.270423 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.270391    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:45:52.561244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.561219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:45:52.563241 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:45:52.563214    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7845019f_f4ce_43b9_aeb6_fbb23ba34312.slice/crio-4595084a8ddb8b35ece6f94fbda99ff472d228b9af9aa38dff14c2afdae01989 WatchSource:0}: Error finding container 4595084a8ddb8b35ece6f94fbda99ff472d228b9af9aa38dff14c2afdae01989: Status 404 returned error can't find the container with id 4595084a8ddb8b35ece6f94fbda99ff472d228b9af9aa38dff14c2afdae01989
Aug 04 15:45:52.774966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.774925    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" event={"ID":"aad702f2-b13e-48b3-a23a-28fdd981d89e","Type":"ContainerStarted","Data":"f45856f52f25d5abc3836f220389b22cf3e175ec29221af8066c042840bbd53c"}
Aug 04 15:45:52.775128 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.775087    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:45:52.775128 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.775121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" event={"ID":"aad702f2-b13e-48b3-a23a-28fdd981d89e","Type":"ContainerStarted","Data":"3b08efdcaca56791817605f5adfa6cd603e8851170b587c85dfdcb0bbdfbb97e"}
Aug 04 15:45:52.776384 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.776353    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" event={"ID":"7845019f-f4ce-43b9-aeb6-fbb23ba34312","Type":"ContainerStarted","Data":"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"}
Aug 04 15:45:52.776530 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.776401    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:45:52.776530 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.776423    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" event={"ID":"7845019f-f4ce-43b9-aeb6-fbb23ba34312","Type":"ContainerStarted","Data":"4595084a8ddb8b35ece6f94fbda99ff472d228b9af9aa38dff14c2afdae01989"}
Aug 04 15:45:52.778150 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.778128    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" event={"ID":"00b6eef0-1876-4f0f-a112-e959e8db3750","Type":"ContainerStarted","Data":"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"}
Aug 04 15:45:52.778262 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.778161    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" event={"ID":"00b6eef0-1876-4f0f-a112-e959e8db3750","Type":"ContainerStarted","Data":"d23831032d4e556a4d085970903071ee0afacf947df59587d99088c175c52c46"}
Aug 04 15:45:52.778262 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.778206    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:45:52.795043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.795003    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" podStartSLOduration=2.321667364 podStartE2EDuration="2.794989275s" totalImagesPullingTime="473.321911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:45:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:45:52.793674967 +0000 UTC m=+2345.625643085" watchObservedRunningTime="2026-08-04 15:45:52.794989275 +0000 UTC m=+2345.626957422"
Aug 04 15:45:52.812065 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.812020    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" podStartSLOduration=1.812007193 podStartE2EDuration="1.812007193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:45:52.809513225 +0000 UTC m=+2345.641481343" watchObservedRunningTime="2026-08-04 15:45:52.812007193 +0000 UTC m=+2345.643975311"
Aug 04 15:45:52.827895 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:52.827061    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" podStartSLOduration=1.827046112 podStartE2EDuration="1.827046112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:45:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:45:52.826441669 +0000 UTC m=+2345.658409787" watchObservedRunningTime="2026-08-04 15:45:52.827046112 +0000 UTC m=+2345.659014233"
Aug 04 15:45:58.789462 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:45:58.789428    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:46:03.785394 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:03.785362    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:46:03.785754 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:03.785437    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:46:04.371567 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:04.371531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:46:19.804843 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:19.804801    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:46:28.968388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.968357    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:46:28.971977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.971959    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:28.976044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.976016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-01d7a1ad\"/\"e2e-lifecycle-model-01d7a1ad-kserve-self-signed-certs\""
Aug 04 15:46:28.976153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.976038    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-01d7a1ad\"/\"openshift-service-ca.crt\""
Aug 04 15:46:28.976153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.976073    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-01d7a1ad\"/\"kube-root-ca.crt\""
Aug 04 15:46:28.976153 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.976101    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-01d7a1ad\"/\"default-dockercfg-7j9mx\""
Aug 04 15:46:28.981277 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.981256    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:46:28.996673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:28.996648    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:46:29.095876 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.095843    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.095988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.095899    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.095988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.095925    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24cb8\" (UniqueName: \"kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.095988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.095953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.096098 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.096041    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.096098 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.096070    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197496    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197650 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197650 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197603    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24cb8\" (UniqueName: \"kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.197996 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.197972    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.198121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.198017    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.198121 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.198068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.199970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.199948    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.200051 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.199947    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.207720 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.207697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24cb8\" (UniqueName: \"kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8\") pod \"e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") " pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.282563 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.282510    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:29.411656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.411632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:46:29.414583 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:46:29.414554    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd80debf_515b_4742_8679_b18fa9bcefbf.slice/crio-14570c0cff83a8a0757f02886cc201cafa999da7499ae75dbc5c4b7565c82807 WatchSource:0}: Error finding container 14570c0cff83a8a0757f02886cc201cafa999da7499ae75dbc5c4b7565c82807: Status 404 returned error can't find the container with id 14570c0cff83a8a0757f02886cc201cafa999da7499ae75dbc5c4b7565c82807
Aug 04 15:46:29.969169 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.969131    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" event={"ID":"dd80debf-515b-4742-8679-b18fa9bcefbf","Type":"ContainerStarted","Data":"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"}
Aug 04 15:46:29.969525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.969174    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" event={"ID":"dd80debf-515b-4742-8679-b18fa9bcefbf","Type":"ContainerStarted","Data":"14570c0cff83a8a0757f02886cc201cafa999da7499ae75dbc5c4b7565c82807"}
Aug 04 15:46:29.987627 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:29.987582    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" podStartSLOduration=1.987566414 podStartE2EDuration="1.987566414s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:46:29.986900309 +0000 UTC m=+2382.818868429" watchObservedRunningTime="2026-08-04 15:46:29.987566414 +0000 UTC m=+2382.819534576"
Aug 04 15:46:39.282791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:39.282753    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:39.283169 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:39.282841    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:39.295050 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:39.295027    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:40.032359 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:40.032325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:46:59.492928 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:46:59.492891    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:20.067306 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.067208    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:47:20.067746 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.067507    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" podUID="aad702f2-b13e-48b3-a23a-28fdd981d89e" containerName="maas-api" containerID="cri-o://f45856f52f25d5abc3836f220389b22cf3e175ec29221af8066c042840bbd53c" gracePeriod=30
Aug 04 15:47:20.198969 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.198931    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:47:20.199219 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.199188    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" podUID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" containerName="payload-processing" containerID="cri-o://887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f" gracePeriod=30
Aug 04 15:47:20.209475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.209448    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:20.223486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.221964    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:47:20.223486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.222172    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" podUID="00b6eef0-1876-4f0f-a112-e959e8db3750" containerName="payload-pre-processing" containerID="cri-o://7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197" gracePeriod=30
Aug 04 15:47:20.237387 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.237356    2571 generic.go:356] "Generic (PLEG): container finished" podID="aad702f2-b13e-48b3-a23a-28fdd981d89e" containerID="f45856f52f25d5abc3836f220389b22cf3e175ec29221af8066c042840bbd53c" exitCode=0
Aug 04 15:47:20.237518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.237470    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" event={"ID":"aad702f2-b13e-48b3-a23a-28fdd981d89e","Type":"ContainerDied","Data":"f45856f52f25d5abc3836f220389b22cf3e175ec29221af8066c042840bbd53c"}
Aug 04 15:47:20.339790 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.339757    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:20.345065 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.345044    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:47:20.442888 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.442784    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") pod \"aad702f2-b13e-48b3-a23a-28fdd981d89e\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") "
Aug 04 15:47:20.443825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.443130    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca\") pod \"aad702f2-b13e-48b3-a23a-28fdd981d89e\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") "
Aug 04 15:47:20.443825 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.443195    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lzch\" (UniqueName: \"kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch\") pod \"aad702f2-b13e-48b3-a23a-28fdd981d89e\" (UID: \"aad702f2-b13e-48b3-a23a-28fdd981d89e\") "
Aug 04 15:47:20.444369 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.444336    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aad702f2-b13e-48b3-a23a-28fdd981d89e" (UID: "aad702f2-b13e-48b3-a23a-28fdd981d89e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:47:20.446101 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.446079    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aad702f2-b13e-48b3-a23a-28fdd981d89e" (UID: "aad702f2-b13e-48b3-a23a-28fdd981d89e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:47:20.446186 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.446125    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch" (OuterVolumeSpecName: "kube-api-access-2lzch") pod "aad702f2-b13e-48b3-a23a-28fdd981d89e" (UID: "aad702f2-b13e-48b3-a23a-28fdd981d89e"). InnerVolumeSpecName "kube-api-access-2lzch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:47:20.485988 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.485964    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:47:20.503218 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.503198    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:47:20.512681 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.512647    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:20.544139 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.544115    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aad702f2-b13e-48b3-a23a-28fdd981d89e-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.544139 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.544138    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aad702f2-b13e-48b3-a23a-28fdd981d89e-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.544266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.544147    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lzch\" (UniqueName: \"kubernetes.io/projected/aad702f2-b13e-48b3-a23a-28fdd981d89e-kube-api-access-2lzch\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.645217 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645191    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9swd\" (UniqueName: \"kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd\") pod \"00b6eef0-1876-4f0f-a112-e959e8db3750\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") "
Aug 04 15:47:20.645428 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645409    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume\") pod \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") "
Aug 04 15:47:20.645500 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645445    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume\") pod \"00b6eef0-1876-4f0f-a112-e959e8db3750\" (UID: \"00b6eef0-1876-4f0f-a112-e959e8db3750\") "
Aug 04 15:47:20.645500 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645491    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz7hj\" (UniqueName: \"kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj\") pod \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\" (UID: \"7845019f-f4ce-43b9-aeb6-fbb23ba34312\") "
Aug 04 15:47:20.645791 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645768    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7845019f-f4ce-43b9-aeb6-fbb23ba34312" (UID: "7845019f-f4ce-43b9-aeb6-fbb23ba34312"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:47:20.645872 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.645834    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00b6eef0-1876-4f0f-a112-e959e8db3750" (UID: "00b6eef0-1876-4f0f-a112-e959e8db3750"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:47:20.647303 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.647276    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd" (OuterVolumeSpecName: "kube-api-access-x9swd") pod "00b6eef0-1876-4f0f-a112-e959e8db3750" (UID: "00b6eef0-1876-4f0f-a112-e959e8db3750"). InnerVolumeSpecName "kube-api-access-x9swd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:47:20.647546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.647526    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj" (OuterVolumeSpecName: "kube-api-access-kz7hj") pod "7845019f-f4ce-43b9-aeb6-fbb23ba34312" (UID: "7845019f-f4ce-43b9-aeb6-fbb23ba34312"). InnerVolumeSpecName "kube-api-access-kz7hj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:47:20.655308 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.655274    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:20.746613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.746591    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz7hj\" (UniqueName: \"kubernetes.io/projected/7845019f-f4ce-43b9-aeb6-fbb23ba34312-kube-api-access-kz7hj\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.746613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.746612    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9swd\" (UniqueName: \"kubernetes.io/projected/00b6eef0-1876-4f0f-a112-e959e8db3750-kube-api-access-x9swd\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.746727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.746623    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7845019f-f4ce-43b9-aeb6-fbb23ba34312-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:20.746727 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:20.746631    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b6eef0-1876-4f0f-a112-e959e8db3750-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:21.243821 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.243796    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"
Aug 04 15:47:21.244200 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.243840    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm" event={"ID":"aad702f2-b13e-48b3-a23a-28fdd981d89e","Type":"ContainerDied","Data":"3b08efdcaca56791817605f5adfa6cd603e8851170b587c85dfdcb0bbdfbb97e"}
Aug 04 15:47:21.244200 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.243901    2571 scope.go:117] "RemoveContainer" containerID="f45856f52f25d5abc3836f220389b22cf3e175ec29221af8066c042840bbd53c"
Aug 04 15:47:21.245401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.245204    2571 generic.go:356] "Generic (PLEG): container finished" podID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" containerID="887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f" exitCode=0
Aug 04 15:47:21.245401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.245250    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"
Aug 04 15:47:21.245401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.245302    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" event={"ID":"7845019f-f4ce-43b9-aeb6-fbb23ba34312","Type":"ContainerDied","Data":"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"}
Aug 04 15:47:21.245401 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.245348    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq" event={"ID":"7845019f-f4ce-43b9-aeb6-fbb23ba34312","Type":"ContainerDied","Data":"4595084a8ddb8b35ece6f94fbda99ff472d228b9af9aa38dff14c2afdae01989"}
Aug 04 15:47:21.257142 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.257110    2571 generic.go:356] "Generic (PLEG): container finished" podID="00b6eef0-1876-4f0f-a112-e959e8db3750" containerID="7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197" exitCode=0
Aug 04 15:47:21.257240 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.257179    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" event={"ID":"00b6eef0-1876-4f0f-a112-e959e8db3750","Type":"ContainerDied","Data":"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"}
Aug 04 15:47:21.257240 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.257206    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"
Aug 04 15:47:21.257383 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.257251    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt" event={"ID":"00b6eef0-1876-4f0f-a112-e959e8db3750","Type":"ContainerDied","Data":"d23831032d4e556a4d085970903071ee0afacf947df59587d99088c175c52c46"}
Aug 04 15:47:21.259107 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.259089    2571 scope.go:117] "RemoveContainer" containerID="887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"
Aug 04 15:47:21.268054 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.268041    2571 scope.go:117] "RemoveContainer" containerID="887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"
Aug 04 15:47:21.268325 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:47:21.268305    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f\": container with ID starting with 887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f not found: ID does not exist" containerID="887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"
Aug 04 15:47:21.268382 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.268334    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f"} err="failed to get container status \"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f\": rpc error: code = NotFound desc = could not find container \"887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f\": container with ID starting with 887743a8a9387930423278e23a1d4fb814035615053fd4ff4625d3a59c515c6f not found: ID does not exist"
Aug 04 15:47:21.268382 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.268350    2571 scope.go:117] "RemoveContainer" containerID="7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"
Aug 04 15:47:21.273247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.273228    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:47:21.276452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.276432    2571 scope.go:117] "RemoveContainer" containerID="7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"
Aug 04 15:47:21.276701 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:47:21.276680    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197\": container with ID starting with 7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197 not found: ID does not exist" containerID="7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"
Aug 04 15:47:21.276779 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.276705    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197"} err="failed to get container status \"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197\": rpc error: code = NotFound desc = could not find container \"7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197\": container with ID starting with 7ca164a20440f68d978e49edda3d3ed88b2b5b0f299242276b48e568c90ad197 not found: ID does not exist"
Aug 04 15:47:21.280252 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.280231    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-01d7a1ad-5d797b9554-mh8rq"]
Aug 04 15:47:21.298163 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.298092    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:47:21.300194 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.300177    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-01d7a1ad-7f47858b98-259tm"]
Aug 04 15:47:21.315363 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.315344    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:47:21.321325 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.321305    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-01d7a1ad-56f94bd876-ldqgt"]
Aug 04 15:47:21.725667 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.725638    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b6eef0-1876-4f0f-a112-e959e8db3750" path="/var/lib/kubelet/pods/00b6eef0-1876-4f0f-a112-e959e8db3750/volumes"
Aug 04 15:47:21.726042 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.726026    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" path="/var/lib/kubelet/pods/7845019f-f4ce-43b9-aeb6-fbb23ba34312/volumes"
Aug 04 15:47:21.726444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:21.726429    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aad702f2-b13e-48b3-a23a-28fdd981d89e" path="/var/lib/kubelet/pods/aad702f2-b13e-48b3-a23a-28fdd981d89e/volumes"
Aug 04 15:47:23.860553 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:23.860514    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:28.842351 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:28.842311    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:47:28.936830 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:28.936798    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:47:43.861786 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:43.861719    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" podUID="dd80debf-515b-4742-8679-b18fa9bcefbf" containerName="main" containerID="cri-o://73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8" gracePeriod=45
Aug 04 15:47:44.120329 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.120251    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:47:44.255090 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255062    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255115    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255166    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255185    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24cb8\" (UniqueName: \"kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255247 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255223    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255264    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm\") pod \"dd80debf-515b-4742-8679-b18fa9bcefbf\" (UID: \"dd80debf-515b-4742-8679-b18fa9bcefbf\") "
Aug 04 15:47:44.255508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255356    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache" (OuterVolumeSpecName: "model-cache") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:47:44.255508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255422    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:47:44.255508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255454    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home" (OuterVolumeSpecName: "home") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:47:44.255675 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255662    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-model-cache\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.255732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255677    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-tmp-dir\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.255732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.255686    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-home\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.257412 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.257378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:47:44.257529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.257469    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm" (OuterVolumeSpecName: "dshm") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 04 15:47:44.257529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.257473    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8" (OuterVolumeSpecName: "kube-api-access-24cb8") pod "dd80debf-515b-4742-8679-b18fa9bcefbf" (UID: "dd80debf-515b-4742-8679-b18fa9bcefbf"). InnerVolumeSpecName "kube-api-access-24cb8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:47:44.356282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.356252    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd80debf-515b-4742-8679-b18fa9bcefbf-tls-certs\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.356282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.356279    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd80debf-515b-4742-8679-b18fa9bcefbf-dshm\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.356437 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.356307    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24cb8\" (UniqueName: \"kubernetes.io/projected/dd80debf-515b-4742-8679-b18fa9bcefbf-kube-api-access-24cb8\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:47:44.379705 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.379681    2571 generic.go:356] "Generic (PLEG): container finished" podID="dd80debf-515b-4742-8679-b18fa9bcefbf" containerID="73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8" exitCode=0
Aug 04 15:47:44.379816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.379720    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"
Aug 04 15:47:44.379816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.379779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" event={"ID":"dd80debf-515b-4742-8679-b18fa9bcefbf","Type":"ContainerDied","Data":"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"}
Aug 04 15:47:44.379913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.379821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59" event={"ID":"dd80debf-515b-4742-8679-b18fa9bcefbf","Type":"ContainerDied","Data":"14570c0cff83a8a0757f02886cc201cafa999da7499ae75dbc5c4b7565c82807"}
Aug 04 15:47:44.379913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.379841    2571 scope.go:117] "RemoveContainer" containerID="73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"
Aug 04 15:47:44.388444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.388425    2571 scope.go:117] "RemoveContainer" containerID="73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"
Aug 04 15:47:44.388658 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:47:44.388641    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8\": container with ID starting with 73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8 not found: ID does not exist" containerID="73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"
Aug 04 15:47:44.388706 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.388666    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8"} err="failed to get container status \"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8\": rpc error: code = NotFound desc = could not find container \"73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8\": container with ID starting with 73fbacc56bce1aad6c04b2f7ebb9cf0beb5eacdd74145570ec0c715a75c697e8 not found: ID does not exist"
Aug 04 15:47:44.403481 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.403449    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:47:44.405567 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:44.405547    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-01d7a1ad/e2e-lifecycle-model-01d7a1ad-kserve-6ccf4df887-5fd59"]
Aug 04 15:47:45.724932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:47:45.724893    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd80debf-515b-4742-8679-b18fa9bcefbf" path="/var/lib/kubelet/pods/dd80debf-515b-4742-8679-b18fa9bcefbf/volumes"
Aug 04 15:48:05.406421 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:05.406378    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:06.264099 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:06.264064    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:12.661751 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:12.661710    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:12.776266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:12.776235    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:13.017157 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:13.017094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:34.730040 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:34.729996    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:34.838172 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:34.838141    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:34.940136 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:34.940109    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:35.622395 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:35.622359    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:35.720084 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:35.720054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:38.748798 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:38.748761    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:38.814540 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:38.814508    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:44.480082 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:44.480046    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:44.573952 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:44.573927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:45.251602 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:45.251563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:51.259682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:51.259643    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:51.371962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:51.371928    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:48:51.514546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:48:51.514479    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:02.055437 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:02.055398    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:02.306907 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:02.306827    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:23.339189 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:23.339148    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:24.809044 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:24.809009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:24.942173 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:24.942143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:29.895558 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:29.895518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:30.040062 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:30.040030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:30.297053 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:30.296973    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:30.669412 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:30.669379    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:31.359397 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:31.359367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:33.930788 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:33.930756    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:34.024433 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:34.024402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.187529    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188652    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b6eef0-1876-4f0f-a112-e959e8db3750" containerName="payload-pre-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188677    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b6eef0-1876-4f0f-a112-e959e8db3750" containerName="payload-pre-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188718    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd80debf-515b-4742-8679-b18fa9bcefbf" containerName="main"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188728    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd80debf-515b-4742-8679-b18fa9bcefbf" containerName="main"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188757    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aad702f2-b13e-48b3-a23a-28fdd981d89e" containerName="maas-api"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188766    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aad702f2-b13e-48b3-a23a-28fdd981d89e" containerName="maas-api"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188794    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" containerName="payload-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188803    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" containerName="payload-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.188999    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aad702f2-b13e-48b3-a23a-28fdd981d89e" containerName="maas-api"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.189023    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b6eef0-1876-4f0f-a112-e959e8db3750" containerName="payload-pre-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.189043    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7845019f-f4ce-43b9-aeb6-fbb23ba34312" containerName="payload-processing"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.189061    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd80debf-515b-4742-8679-b18fa9bcefbf" containerName="main"
Aug 04 15:49:35.195698 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.193682    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.198368 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.198344    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-c2a99b-serving-cert\""
Aug 04 15:49:35.200519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.200489    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:49:35.222662 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.222639    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:35.338135 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.338106    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.338236 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.338165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.338315 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.338235    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw7wx\" (UniqueName: \"kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.373859 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.373838    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:35.439705 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.439682    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw7wx\" (UniqueName: \"kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.439795 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.439750    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.439838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.439799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.440382 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.440363    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.442185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.442164    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.448597 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.448552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw7wx\" (UniqueName: \"kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx\") pod \"maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.506842 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.506816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:35.653556 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.653532    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:49:35.655725 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:49:35.655699    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6975d471_a51a_412d_8d9b_a1b496588837.slice/crio-78ee3c23db63feb3564bb3607c45721c2a8ade0c5eeb52d8a31c8e6fe4214b56 WatchSource:0}: Error finding container 78ee3c23db63feb3564bb3607c45721c2a8ade0c5eeb52d8a31c8e6fe4214b56: Status 404 returned error can't find the container with id 78ee3c23db63feb3564bb3607c45721c2a8ade0c5eeb52d8a31c8e6fe4214b56
Aug 04 15:49:35.751813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.751749    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:35.863175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.863144    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:35.922909 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.922877    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:49:35.927475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.927456    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:35.930580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.930559    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-c2a99b-dockercfg-hf82w\""
Aug 04 15:49:35.930904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.930888    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-c2a99b\""
Aug 04 15:49:35.947732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.947712    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" event={"ID":"6975d471-a51a-412d-8d9b-a1b496588837","Type":"ContainerStarted","Data":"78ee3c23db63feb3564bb3607c45721c2a8ade0c5eeb52d8a31c8e6fe4214b56"}
Aug 04 15:49:35.956827 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.956802    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:49:35.960844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.960826    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:49:35.960947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.960923    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:35.983393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:35.983368    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:49:36.045906 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.045853    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsqhs\" (UniqueName: \"kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.045906 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.045902    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.046035 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.045956    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzf9p\" (UniqueName: \"kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.046073 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.046039    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.146832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.146806    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsqhs\" (UniqueName: \"kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.146940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.146877    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.146940 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.146907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzf9p\" (UniqueName: \"kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.147119 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.146998    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.147832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.147809    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.147902 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.147856    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.155274 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.155243    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzf9p\" (UniqueName: \"kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p\") pod \"payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.155377 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.155349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsqhs\" (UniqueName: \"kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs\") pod \"payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") " pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.237641 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.237622    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.270372 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.270347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.387187 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.387157    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:49:36.388886 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:49:36.388855    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2396208d_98ba_407a_934d_f26b248d2cbf.slice/crio-47e9acb851f6eec2ae8d9323e340bf14b04d0e8b036c24d8fdb10e4267ba40a4 WatchSource:0}: Error finding container 47e9acb851f6eec2ae8d9323e340bf14b04d0e8b036c24d8fdb10e4267ba40a4: Status 404 returned error can't find the container with id 47e9acb851f6eec2ae8d9323e340bf14b04d0e8b036c24d8fdb10e4267ba40a4
Aug 04 15:49:36.626556 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.626530    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:49:36.628656 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:49:36.628629    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86829f15_10f0_44e2_8ebd_08aa0c8e36b0.slice/crio-e4aa5ad23b3d73f1445f42f6238a6f487fb6d0d16a29246426feae7bc09d04ee WatchSource:0}: Error finding container e4aa5ad23b3d73f1445f42f6238a6f487fb6d0d16a29246426feae7bc09d04ee: Status 404 returned error can't find the container with id e4aa5ad23b3d73f1445f42f6238a6f487fb6d0d16a29246426feae7bc09d04ee
Aug 04 15:49:36.957464 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.957422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" event={"ID":"2396208d-98ba-407a-934d-f26b248d2cbf","Type":"ContainerStarted","Data":"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"}
Aug 04 15:49:36.957640 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.957605    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:36.957714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.957647    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" event={"ID":"2396208d-98ba-407a-934d-f26b248d2cbf","Type":"ContainerStarted","Data":"47e9acb851f6eec2ae8d9323e340bf14b04d0e8b036c24d8fdb10e4267ba40a4"}
Aug 04 15:49:36.959060 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.959027    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" event={"ID":"86829f15-10f0-44e2-8ebd-08aa0c8e36b0","Type":"ContainerStarted","Data":"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"}
Aug 04 15:49:36.959190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.959083    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" event={"ID":"86829f15-10f0-44e2-8ebd-08aa0c8e36b0","Type":"ContainerStarted","Data":"e4aa5ad23b3d73f1445f42f6238a6f487fb6d0d16a29246426feae7bc09d04ee"}
Aug 04 15:49:36.959190 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.959115    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:36.960506 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.960486    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" event={"ID":"6975d471-a51a-412d-8d9b-a1b496588837","Type":"ContainerStarted","Data":"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"}
Aug 04 15:49:36.960621 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.960600    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:36.979762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:36.979698    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" podStartSLOduration=1.979679505 podStartE2EDuration="1.979679505s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:49:36.978791421 +0000 UTC m=+2569.810759539" watchObservedRunningTime="2026-08-04 15:49:36.979679505 +0000 UTC m=+2569.811647621"
Aug 04 15:49:37.000461 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:37.000421    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" podStartSLOduration=2.000408212 podStartE2EDuration="2.000408212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:49:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:49:36.998381144 +0000 UTC m=+2569.830349264" watchObservedRunningTime="2026-08-04 15:49:37.000408212 +0000 UTC m=+2569.832376376"
Aug 04 15:49:37.020204 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:37.020164    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" podStartSLOduration=1.546204918 podStartE2EDuration="2.020151926s" totalImagesPullingTime="473.947008ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:49:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:49:37.019382736 +0000 UTC m=+2569.851350852" watchObservedRunningTime="2026-08-04 15:49:37.020151926 +0000 UTC m=+2569.852120042"
Aug 04 15:49:42.971265 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:42.971231    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:49:47.967676 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:47.967647    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:49:47.968107 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:47.967724    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:49:58.955446 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:58.955412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:59.327284 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:59.327204    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:59.645283 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:59.645251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:49:59.908533 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:49:59.908464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:03.169404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:03.169368    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:03.264388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:03.264356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:04.390228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.390189    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:50:04.394700 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.394674    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.397330 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.397308    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-926308-serving-cert\""
Aug 04 15:50:04.400813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.400790    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:50:04.419193 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.419162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:04.480492 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.480467    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.480605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.480522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.480605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.480577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgnf8\" (UniqueName: \"kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.581062 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.581037    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.581176 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.581104    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.581176 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.581132    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgnf8\" (UniqueName: \"kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.581255 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:50:04.581196    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-serving-cert: secret "maas-api-e2e-inf-b-926308-serving-cert" not found
Aug 04 15:50:04.581317 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:50:04.581275    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls podName:7699be29-d4cf-420d-ab91-5c304fdfeac9 nodeName:}" failed. No retries permitted until 2026-08-04 15:50:05.08125679 +0000 UTC m=+2597.913224886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls") pod "maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" (UID: "7699be29-d4cf-420d-ab91-5c304fdfeac9") : secret "maas-api-e2e-inf-b-926308-serving-cert" not found
Aug 04 15:50:04.581796 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.581778    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.590502 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.590479    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgnf8\" (UniqueName: \"kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:04.709444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:04.709384    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:05.086162 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.086094    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:05.088606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.088577    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") pod \"maas-api-e2e-inf-b-926308-5bb7969c8-qhslb\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:05.108862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.108839    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:05.116393 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.116373    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:50:05.119995 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.119979    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.122714 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.122697    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-926308-dockercfg-l6r2q\""
Aug 04 15:50:05.122788 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.122721    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-926308\""
Aug 04 15:50:05.129862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.129840    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:50:05.171709 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.171681    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:50:05.175241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.175223    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.183348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.183329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:50:05.186605 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.186586    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.186696 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.186650    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2qlb\" (UniqueName: \"kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.187033 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.187015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:05.287659 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.287625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2qlb\" (UniqueName: \"kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.287820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.287694    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd9lz\" (UniqueName: \"kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.287820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.287742    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.287820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.287809    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.288511 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.288489    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.295844 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.295815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2qlb\" (UniqueName: \"kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb\") pod \"payload-processing-e2e-inf-b-926308-6476c66d68-665dz\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") " pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.306722 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.306699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:05.389661 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.388832    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.389661 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.389016    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd9lz\" (UniqueName: \"kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.389858 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.389722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.397802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.397775    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd9lz\" (UniqueName: \"kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz\") pod \"payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.431630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.431523    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:05.442333 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.442307    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:50:05.446717 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:50:05.446689    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7699be29_d4cf_420d_ab91_5c304fdfeac9.slice/crio-01986f7dfb49e2236601b08890b41915f00bdd17ce32cf74fc3c32455d87291d WatchSource:0}: Error finding container 01986f7dfb49e2236601b08890b41915f00bdd17ce32cf74fc3c32455d87291d: Status 404 returned error can't find the container with id 01986f7dfb49e2236601b08890b41915f00bdd17ce32cf74fc3c32455d87291d
Aug 04 15:50:05.486546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.486506    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:05.627331 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.627301    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:50:05.628730 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:50:05.628688    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71919f93_cc41_4180_900a_7f402f7494b7.slice/crio-41cef74072b1c2d48340bb4d56fc927f0d92714aaab392a23bcb90e99758b38e WatchSource:0}: Error finding container 41cef74072b1c2d48340bb4d56fc927f0d92714aaab392a23bcb90e99758b38e: Status 404 returned error can't find the container with id 41cef74072b1c2d48340bb4d56fc927f0d92714aaab392a23bcb90e99758b38e
Aug 04 15:50:05.795267 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:05.795242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:50:05.796050 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:50:05.796023    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff2efd0_d11d_404c_8456_02b388d339b7.slice/crio-1f0ac48091f20d0aac808c7469dedf7bff37294634a3f08067dbbfecf2edc8d1 WatchSource:0}: Error finding container 1f0ac48091f20d0aac808c7469dedf7bff37294634a3f08067dbbfecf2edc8d1: Status 404 returned error can't find the container with id 1f0ac48091f20d0aac808c7469dedf7bff37294634a3f08067dbbfecf2edc8d1
Aug 04 15:50:06.116150 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.116117    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" event={"ID":"aff2efd0-d11d-404c-8456-02b388d339b7","Type":"ContainerStarted","Data":"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"}
Aug 04 15:50:06.116366 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.116172    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" event={"ID":"aff2efd0-d11d-404c-8456-02b388d339b7","Type":"ContainerStarted","Data":"1f0ac48091f20d0aac808c7469dedf7bff37294634a3f08067dbbfecf2edc8d1"}
Aug 04 15:50:06.116366 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.116216    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:06.117695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.117662    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" event={"ID":"7699be29-d4cf-420d-ab91-5c304fdfeac9","Type":"ContainerStarted","Data":"01986f7dfb49e2236601b08890b41915f00bdd17ce32cf74fc3c32455d87291d"}
Aug 04 15:50:06.119527 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.119493    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" event={"ID":"71919f93-cc41-4180-900a-7f402f7494b7","Type":"ContainerStarted","Data":"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"}
Aug 04 15:50:06.119647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.119549    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" event={"ID":"71919f93-cc41-4180-900a-7f402f7494b7","Type":"ContainerStarted","Data":"41cef74072b1c2d48340bb4d56fc927f0d92714aaab392a23bcb90e99758b38e"}
Aug 04 15:50:06.119647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.119581    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:06.134613 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.134559    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" podStartSLOduration=1.1345409929999999 podStartE2EDuration="1.134540993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:50:06.134076899 +0000 UTC m=+2598.966045021" watchObservedRunningTime="2026-08-04 15:50:06.134540993 +0000 UTC m=+2598.966509113"
Aug 04 15:50:06.155399 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:06.155360    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" podStartSLOduration=1.155341869 podStartE2EDuration="1.155341869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:50:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:50:06.153718816 +0000 UTC m=+2598.985686935" watchObservedRunningTime="2026-08-04 15:50:06.155341869 +0000 UTC m=+2598.987309985"
Aug 04 15:50:10.142217 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:10.142181    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" event={"ID":"7699be29-d4cf-420d-ab91-5c304fdfeac9","Type":"ContainerStarted","Data":"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"}
Aug 04 15:50:10.142619 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:10.142330    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:16.152913 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:16.152879    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:50:16.209932 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:16.209877    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" podStartSLOduration=8.094156059 podStartE2EDuration="12.209861734s" totalImagesPullingTime="4.115705675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:50:10.161216652 +0000 UTC m=+2602.993184765" watchObservedRunningTime="2026-08-04 15:50:16.209861734 +0000 UTC m=+2609.041829850"
Aug 04 15:50:17.126943 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:17.126916    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:50:17.127099 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:17.126988    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:50:28.149306 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:28.149267    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:50:34.404453 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:50:34.404423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:51:07.779490 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:07.779452    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:51:48.284576 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:48.284538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:51:49.625641 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:49.625608    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:51:59.949156 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:59.949118    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:51:59.949632 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:59.949370    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" podUID="6975d471-a51a-412d-8d9b-a1b496588837" containerName="maas-api" containerID="cri-o://0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982" gracePeriod=30
Aug 04 15:51:59.978123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:51:59.978101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:00.009785 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.009762    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:52:00.009966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.009943    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" podUID="2396208d-98ba-407a-934d-f26b248d2cbf" containerName="payload-processing" containerID="cri-o://31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b" gracePeriod=30
Aug 04 15:52:00.019390 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.019365    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:52:00.019590 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.019568    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" podUID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" containerName="payload-pre-processing" containerID="cri-o://1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e" gracePeriod=30
Aug 04 15:52:00.056656 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.056630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:00.121123 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.121101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:00.189134 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.189057    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:00.276665 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.276637    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:52:00.313756 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.313725    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:52:00.324459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.324438    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:52:00.420008 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.419987    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qzf9p\" (UniqueName: \"kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p\") pod \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") "
Aug 04 15:52:00.420144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420048    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw7wx\" (UniqueName: \"kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx\") pod \"6975d471-a51a-412d-8d9b-a1b496588837\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") "
Aug 04 15:52:00.420144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420086    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume\") pod \"2396208d-98ba-407a-934d-f26b248d2cbf\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") "
Aug 04 15:52:00.420144 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420120    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume\") pod \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\" (UID: \"86829f15-10f0-44e2-8ebd-08aa0c8e36b0\") "
Aug 04 15:52:00.420344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420148    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls\") pod \"6975d471-a51a-412d-8d9b-a1b496588837\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") "
Aug 04 15:52:00.420344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca\") pod \"6975d471-a51a-412d-8d9b-a1b496588837\" (UID: \"6975d471-a51a-412d-8d9b-a1b496588837\") "
Aug 04 15:52:00.420344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420263    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nsqhs\" (UniqueName: \"kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs\") pod \"2396208d-98ba-407a-934d-f26b248d2cbf\" (UID: \"2396208d-98ba-407a-934d-f26b248d2cbf\") "
Aug 04 15:52:00.420647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420608    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86829f15-10f0-44e2-8ebd-08aa0c8e36b0" (UID: "86829f15-10f0-44e2-8ebd-08aa0c8e36b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:00.420647 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420625    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2396208d-98ba-407a-934d-f26b248d2cbf" (UID: "2396208d-98ba-407a-934d-f26b248d2cbf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:00.420758 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.420637    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6975d471-a51a-412d-8d9b-a1b496588837" (UID: "6975d471-a51a-412d-8d9b-a1b496588837"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:00.422375 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.422346    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs" (OuterVolumeSpecName: "kube-api-access-nsqhs") pod "2396208d-98ba-407a-934d-f26b248d2cbf" (UID: "2396208d-98ba-407a-934d-f26b248d2cbf"). InnerVolumeSpecName "kube-api-access-nsqhs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:00.422516 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.422492    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6975d471-a51a-412d-8d9b-a1b496588837" (UID: "6975d471-a51a-412d-8d9b-a1b496588837"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:52:00.422695 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.422676    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p" (OuterVolumeSpecName: "kube-api-access-qzf9p") pod "86829f15-10f0-44e2-8ebd-08aa0c8e36b0" (UID: "86829f15-10f0-44e2-8ebd-08aa0c8e36b0"). InnerVolumeSpecName "kube-api-access-qzf9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:00.422767 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.422725    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx" (OuterVolumeSpecName: "kube-api-access-hw7wx") pod "6975d471-a51a-412d-8d9b-a1b496588837" (UID: "6975d471-a51a-412d-8d9b-a1b496588837"). InnerVolumeSpecName "kube-api-access-hw7wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521186    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6975d471-a51a-412d-8d9b-a1b496588837-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521207    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nsqhs\" (UniqueName: \"kubernetes.io/projected/2396208d-98ba-407a-934d-f26b248d2cbf-kube-api-access-nsqhs\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521219    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qzf9p\" (UniqueName: \"kubernetes.io/projected/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-kube-api-access-qzf9p\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521228    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw7wx\" (UniqueName: \"kubernetes.io/projected/6975d471-a51a-412d-8d9b-a1b496588837-kube-api-access-hw7wx\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521237    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2396208d-98ba-407a-934d-f26b248d2cbf-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521244 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521247    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86829f15-10f0-44e2-8ebd-08aa0c8e36b0-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.521529 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.521256    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6975d471-a51a-412d-8d9b-a1b496588837-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:00.587972 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.587949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:00.755757 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.755734    2571 generic.go:356] "Generic (PLEG): container finished" podID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" containerID="1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e" exitCode=0
Aug 04 15:52:00.755874 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.755768    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"
Aug 04 15:52:00.755874 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.755834    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" event={"ID":"86829f15-10f0-44e2-8ebd-08aa0c8e36b0","Type":"ContainerDied","Data":"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"}
Aug 04 15:52:00.755968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.755892    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986" event={"ID":"86829f15-10f0-44e2-8ebd-08aa0c8e36b0","Type":"ContainerDied","Data":"e4aa5ad23b3d73f1445f42f6238a6f487fb6d0d16a29246426feae7bc09d04ee"}
Aug 04 15:52:00.755968 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.755926    2571 scope.go:117] "RemoveContainer" containerID="1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"
Aug 04 15:52:00.757222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.757202    2571 generic.go:356] "Generic (PLEG): container finished" podID="6975d471-a51a-412d-8d9b-a1b496588837" containerID="0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982" exitCode=0
Aug 04 15:52:00.757347 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.757237    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" event={"ID":"6975d471-a51a-412d-8d9b-a1b496588837","Type":"ContainerDied","Data":"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"}
Aug 04 15:52:00.757347 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.757315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4" event={"ID":"6975d471-a51a-412d-8d9b-a1b496588837","Type":"ContainerDied","Data":"78ee3c23db63feb3564bb3607c45721c2a8ade0c5eeb52d8a31c8e6fe4214b56"}
Aug 04 15:52:00.757347 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.757252    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"
Aug 04 15:52:00.758916 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.758887    2571 generic.go:356] "Generic (PLEG): container finished" podID="2396208d-98ba-407a-934d-f26b248d2cbf" containerID="31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b" exitCode=0
Aug 04 15:52:00.759038 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.758967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" event={"ID":"2396208d-98ba-407a-934d-f26b248d2cbf","Type":"ContainerDied","Data":"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"}
Aug 04 15:52:00.759038 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.759010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq" event={"ID":"2396208d-98ba-407a-934d-f26b248d2cbf","Type":"ContainerDied","Data":"47e9acb851f6eec2ae8d9323e340bf14b04d0e8b036c24d8fdb10e4267ba40a4"}
Aug 04 15:52:00.759038 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.759010    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"
Aug 04 15:52:00.767063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.767042    2571 scope.go:117] "RemoveContainer" containerID="1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"
Aug 04 15:52:00.767428 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:00.767396    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e\": container with ID starting with 1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e not found: ID does not exist" containerID="1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"
Aug 04 15:52:00.767534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.767437    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e"} err="failed to get container status \"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e\": rpc error: code = NotFound desc = could not find container \"1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e\": container with ID starting with 1662c0662e416d692a1828e9a718dfe42b09fe054f307bca787210ac5f2cd88e not found: ID does not exist"
Aug 04 15:52:00.767534 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.767461    2571 scope.go:117] "RemoveContainer" containerID="0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"
Aug 04 15:52:00.775539 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.775525    2571 scope.go:117] "RemoveContainer" containerID="0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"
Aug 04 15:52:00.775785 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:00.775768    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982\": container with ID starting with 0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982 not found: ID does not exist" containerID="0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"
Aug 04 15:52:00.775820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.775792    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982"} err="failed to get container status \"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982\": rpc error: code = NotFound desc = could not find container \"0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982\": container with ID starting with 0f6dbc9378ce836e2bba412571808aae9d8ac1b86e0e35a384fc3ea76db56982 not found: ID does not exist"
Aug 04 15:52:00.775820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.775807    2571 scope.go:117] "RemoveContainer" containerID="31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"
Aug 04 15:52:00.783821 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.783799    2571 scope.go:117] "RemoveContainer" containerID="31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"
Aug 04 15:52:00.784085 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:00.784068    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b\": container with ID starting with 31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b not found: ID does not exist" containerID="31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"
Aug 04 15:52:00.784151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.784091    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b"} err="failed to get container status \"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b\": rpc error: code = NotFound desc = could not find container \"31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b\": container with ID starting with 31d70f4f9b00659ab83d78cc2f3fc437fcaeadbd1a84bf9c03e1efd206e88f4b not found: ID does not exist"
Aug 04 15:52:00.785803 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.785784    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:52:00.790399 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.790378    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-c2a99b-64876f8f8d-7g986"]
Aug 04 15:52:00.802977 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.802952    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:52:00.808166 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.808145    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-c2a99b-bd9648858-7jpsq"]
Aug 04 15:52:00.820239 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.820220    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:52:00.826266 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:00.826244    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-c2a99b-756558dbd9-ggbc4"]
Aug 04 15:52:01.725214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:01.725182    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2396208d-98ba-407a-934d-f26b248d2cbf" path="/var/lib/kubelet/pods/2396208d-98ba-407a-934d-f26b248d2cbf/volumes"
Aug 04 15:52:01.725618 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:01.725582    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6975d471-a51a-412d-8d9b-a1b496588837" path="/var/lib/kubelet/pods/6975d471-a51a-412d-8d9b-a1b496588837/volumes"
Aug 04 15:52:01.725899 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:01.725884    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" path="/var/lib/kubelet/pods/86829f15-10f0-44e2-8ebd-08aa0c8e36b0/volumes"
Aug 04 15:52:06.747546 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:06.747516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:06.863790 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:06.863762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:07.076710 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:07.076628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:07.627908 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:07.627861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:17.960580 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:17.960538    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:52:17.961069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:17.960816    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" podUID="7699be29-d4cf-420d-ab91-5c304fdfeac9" containerName="maas-api" containerID="cri-o://ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0" gracePeriod=30
Aug 04 15:52:17.986675 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:17.986648    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:18.024799 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.024759    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:52:18.025021 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.024993    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" podUID="aff2efd0-d11d-404c-8456-02b388d339b7" containerName="payload-processing" containerID="cri-o://9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372" gracePeriod=30
Aug 04 15:52:18.033671 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.033636    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:52:18.033906 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.033878    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" podUID="71919f93-cc41-4180-900a-7f402f7494b7" containerName="payload-pre-processing" containerID="cri-o://5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2" gracePeriod=30
Aug 04 15:52:18.075474 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.075447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:18.151369 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.151332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:18.232357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.232260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:18.319973 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.319941    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:52:18.331547 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.331521    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:52:18.346306 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.346259    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:52:18.381122 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381072    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") pod \"7699be29-d4cf-420d-ab91-5c304fdfeac9\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381158    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca\") pod \"7699be29-d4cf-420d-ab91-5c304fdfeac9\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381225    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2qlb\" (UniqueName: \"kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb\") pod \"aff2efd0-d11d-404c-8456-02b388d339b7\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381382    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd9lz\" (UniqueName: \"kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz\") pod \"71919f93-cc41-4180-900a-7f402f7494b7\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381468    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume\") pod \"71919f93-cc41-4180-900a-7f402f7494b7\" (UID: \"71919f93-cc41-4180-900a-7f402f7494b7\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381515    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume\") pod \"aff2efd0-d11d-404c-8456-02b388d339b7\" (UID: \"aff2efd0-d11d-404c-8456-02b388d339b7\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.381568    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgnf8\" (UniqueName: \"kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8\") pod \"7699be29-d4cf-420d-ab91-5c304fdfeac9\" (UID: \"7699be29-d4cf-420d-ab91-5c304fdfeac9\") "
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.383237    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "71919f93-cc41-4180-900a-7f402f7494b7" (UID: "71919f93-cc41-4180-900a-7f402f7494b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.383760    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aff2efd0-d11d-404c-8456-02b388d339b7" (UID: "aff2efd0-d11d-404c-8456-02b388d339b7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:18.384674 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.384096    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7699be29-d4cf-420d-ab91-5c304fdfeac9" (UID: "7699be29-d4cf-420d-ab91-5c304fdfeac9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:52:18.385494 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.385282    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8" (OuterVolumeSpecName: "kube-api-access-qgnf8") pod "7699be29-d4cf-420d-ab91-5c304fdfeac9" (UID: "7699be29-d4cf-420d-ab91-5c304fdfeac9"). InnerVolumeSpecName "kube-api-access-qgnf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:18.385494 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.385355    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7699be29-d4cf-420d-ab91-5c304fdfeac9" (UID: "7699be29-d4cf-420d-ab91-5c304fdfeac9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:52:18.386819 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.386790    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb" (OuterVolumeSpecName: "kube-api-access-t2qlb") pod "aff2efd0-d11d-404c-8456-02b388d339b7" (UID: "aff2efd0-d11d-404c-8456-02b388d339b7"). InnerVolumeSpecName "kube-api-access-t2qlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:18.387414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.387368    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz" (OuterVolumeSpecName: "kube-api-access-vd9lz") pod "71919f93-cc41-4180-900a-7f402f7494b7" (UID: "71919f93-cc41-4180-900a-7f402f7494b7"). InnerVolumeSpecName "kube-api-access-vd9lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482798    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd9lz\" (UniqueName: \"kubernetes.io/projected/71919f93-cc41-4180-900a-7f402f7494b7-kube-api-access-vd9lz\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482829    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/71919f93-cc41-4180-900a-7f402f7494b7-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482839    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aff2efd0-d11d-404c-8456-02b388d339b7-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482848    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgnf8\" (UniqueName: \"kubernetes.io/projected/7699be29-d4cf-420d-ab91-5c304fdfeac9-kube-api-access-qgnf8\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482859    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7699be29-d4cf-420d-ab91-5c304fdfeac9-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482867    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7699be29-d4cf-420d-ab91-5c304fdfeac9-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.482883 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.482875    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2qlb\" (UniqueName: \"kubernetes.io/projected/aff2efd0-d11d-404c-8456-02b388d339b7-kube-api-access-t2qlb\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:52:18.613927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.613894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:18.855562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.855481    2571 generic.go:356] "Generic (PLEG): container finished" podID="aff2efd0-d11d-404c-8456-02b388d339b7" containerID="9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372" exitCode=0
Aug 04 15:52:18.855562 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.855535    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"
Aug 04 15:52:18.855780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.855575    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" event={"ID":"aff2efd0-d11d-404c-8456-02b388d339b7","Type":"ContainerDied","Data":"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"}
Aug 04 15:52:18.855780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.855634    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz" event={"ID":"aff2efd0-d11d-404c-8456-02b388d339b7","Type":"ContainerDied","Data":"1f0ac48091f20d0aac808c7469dedf7bff37294634a3f08067dbbfecf2edc8d1"}
Aug 04 15:52:18.855780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.855660    2571 scope.go:117] "RemoveContainer" containerID="9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"
Aug 04 15:52:18.856924 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.856900    2571 generic.go:356] "Generic (PLEG): container finished" podID="7699be29-d4cf-420d-ab91-5c304fdfeac9" containerID="ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0" exitCode=0
Aug 04 15:52:18.857015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.856951    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"
Aug 04 15:52:18.857015 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.856988    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" event={"ID":"7699be29-d4cf-420d-ab91-5c304fdfeac9","Type":"ContainerDied","Data":"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"}
Aug 04 15:52:18.857130 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.857040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb" event={"ID":"7699be29-d4cf-420d-ab91-5c304fdfeac9","Type":"ContainerDied","Data":"01986f7dfb49e2236601b08890b41915f00bdd17ce32cf74fc3c32455d87291d"}
Aug 04 15:52:18.858441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.858412    2571 generic.go:356] "Generic (PLEG): container finished" podID="71919f93-cc41-4180-900a-7f402f7494b7" containerID="5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2" exitCode=0
Aug 04 15:52:18.858575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.858493    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"
Aug 04 15:52:18.858575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.858516    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" event={"ID":"71919f93-cc41-4180-900a-7f402f7494b7","Type":"ContainerDied","Data":"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"}
Aug 04 15:52:18.858575 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.858567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8" event={"ID":"71919f93-cc41-4180-900a-7f402f7494b7","Type":"ContainerDied","Data":"41cef74072b1c2d48340bb4d56fc927f0d92714aaab392a23bcb90e99758b38e"}
Aug 04 15:52:18.866888 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.866758    2571 scope.go:117] "RemoveContainer" containerID="9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"
Aug 04 15:52:18.867078 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:18.867042    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372\": container with ID starting with 9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372 not found: ID does not exist" containerID="9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"
Aug 04 15:52:18.867138 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.867076    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372"} err="failed to get container status \"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372\": rpc error: code = NotFound desc = could not find container \"9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372\": container with ID starting with 9a6991d7c7420946e125578a9532989b57f0c1bba8d3c8c4ff854d6c6d02b372 not found: ID does not exist"
Aug 04 15:52:18.867138 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.867100    2571 scope.go:117] "RemoveContainer" containerID="ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"
Aug 04 15:52:18.877522 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.877509    2571 scope.go:117] "RemoveContainer" containerID="ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"
Aug 04 15:52:18.877789 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:18.877770    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0\": container with ID starting with ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0 not found: ID does not exist" containerID="ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"
Aug 04 15:52:18.877849 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.877795    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0"} err="failed to get container status \"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0\": rpc error: code = NotFound desc = could not find container \"ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0\": container with ID starting with ea346fcb1221af6d379781a008e0f552f8e5e56a1176cb960f9f35c7ba76d5b0 not found: ID does not exist"
Aug 04 15:52:18.877849 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.877811    2571 scope.go:117] "RemoveContainer" containerID="5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"
Aug 04 15:52:18.883967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.883943    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:52:18.886752 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.886734    2571 scope.go:117] "RemoveContainer" containerID="5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"
Aug 04 15:52:18.886982 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:18.886964    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2\": container with ID starting with 5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2 not found: ID does not exist" containerID="5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"
Aug 04 15:52:18.887043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.886992    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2"} err="failed to get container status \"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2\": rpc error: code = NotFound desc = could not find container \"5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2\": container with ID starting with 5ba7506ba29e47b35c603f9e4d15192c00bd6e1819837ea7bdf41c0c2e7f66d2 not found: ID does not exist"
Aug 04 15:52:18.887623 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.887604    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-926308-6476c66d68-665dz"]
Aug 04 15:52:18.897545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.897522    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:52:18.901538 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.901516    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-926308-76cd7d7596-zb4k8"]
Aug 04 15:52:18.912002 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.911982    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:52:18.913569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:18.913552    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-926308-5bb7969c8-qhslb"]
Aug 04 15:52:19.725048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:19.725011    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="71919f93-cc41-4180-900a-7f402f7494b7" path="/var/lib/kubelet/pods/71919f93-cc41-4180-900a-7f402f7494b7/volumes"
Aug 04 15:52:19.725614 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:19.725427    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7699be29-d4cf-420d-ab91-5c304fdfeac9" path="/var/lib/kubelet/pods/7699be29-d4cf-420d-ab91-5c304fdfeac9/volumes"
Aug 04 15:52:19.725766 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:19.725749    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aff2efd0-d11d-404c-8456-02b388d339b7" path="/var/lib/kubelet/pods/aff2efd0-d11d-404c-8456-02b388d339b7/volumes"
Aug 04 15:52:24.857734 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:24.857703    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:24.949513 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:24.949486    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:25.194528 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:25.194497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:25.441338 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:25.441306    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:25.792889 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:25.792866    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:26.187914 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:26.187883    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:26.387935 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:26.387909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:28.962718 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:28.962686    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:29.057048 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:29.057024    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:30.037373 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037343    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037732    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6975d471-a51a-412d-8d9b-a1b496588837" containerName="maas-api"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037743    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6975d471-a51a-412d-8d9b-a1b496588837" containerName="maas-api"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037754    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2396208d-98ba-407a-934d-f26b248d2cbf" containerName="payload-processing"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037760    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2396208d-98ba-407a-934d-f26b248d2cbf" containerName="payload-processing"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037769    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7699be29-d4cf-420d-ab91-5c304fdfeac9" containerName="maas-api"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037775    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7699be29-d4cf-420d-ab91-5c304fdfeac9" containerName="maas-api"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037783    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71919f93-cc41-4180-900a-7f402f7494b7" containerName="payload-pre-processing"
Aug 04 15:52:30.037802 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037790    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="71919f93-cc41-4180-900a-7f402f7494b7" containerName="payload-pre-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037820    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" containerName="payload-pre-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037826    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" containerName="payload-pre-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037832    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aff2efd0-d11d-404c-8456-02b388d339b7" containerName="payload-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037838    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="aff2efd0-d11d-404c-8456-02b388d339b7" containerName="payload-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037900    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2396208d-98ba-407a-934d-f26b248d2cbf" containerName="payload-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037907    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7699be29-d4cf-420d-ab91-5c304fdfeac9" containerName="maas-api"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037915    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="71919f93-cc41-4180-900a-7f402f7494b7" containerName="payload-pre-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037922    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="86829f15-10f0-44e2-8ebd-08aa0c8e36b0" containerName="payload-pre-processing"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037931    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6975d471-a51a-412d-8d9b-a1b496588837" containerName="maas-api"
Aug 04 15:52:30.038322 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.037937    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="aff2efd0-d11d-404c-8456-02b388d339b7" containerName="payload-processing"
Aug 04 15:52:30.041058 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.041039    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.044570 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.044551    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-bac88d-serving-cert\""
Aug 04 15:52:30.052774 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.052755    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:52:30.076368 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.076346    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:30.077402 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.077377    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vggtf\" (UniqueName: \"kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.077496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.077421    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.077496 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.077451    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.178538 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.178498    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vggtf\" (UniqueName: \"kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.178678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.178553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.178678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.178580    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.178767 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:30.178724    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-serving-cert: secret "maas-api-e2e-api-a-bac88d-serving-cert" not found
Aug 04 15:52:30.178815 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:30.178793    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls podName:596d8114-9f47-4cef-808f-acc14f7d1876 nodeName:}" failed. No retries permitted until 2026-08-04 15:52:30.678777541 +0000 UTC m=+2743.510745640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls") pod "maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" (UID: "596d8114-9f47-4cef-808f-acc14f7d1876") : secret "maas-api-e2e-api-a-bac88d-serving-cert" not found
Aug 04 15:52:30.179142 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.179123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.190228 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.190202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vggtf\" (UniqueName: \"kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.318682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.318629    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:30.598497 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.598408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:30.683586 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.683552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.685819 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.685790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") pod \"maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:30.692830 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.692782    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:30.698831 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.698809    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:52:30.703232 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.703214    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.706838 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.706820    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bac88d\""
Aug 04 15:52:30.713663 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.713639    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:52:30.733475 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.733454    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:52:30.736788 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.736772    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.739881 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.739864    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bac88d-dockercfg-7k7bj\""
Aug 04 15:52:30.746351 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.746329    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:52:30.784407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.784381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.784516 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.784414    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.784596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.784577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drtrm\" (UniqueName: \"kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.784660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.784643    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spzvf\" (UniqueName: \"kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.885582 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.885556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spzvf\" (UniqueName: \"kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.885724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.885614    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.885724 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.885642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.885816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.885741    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drtrm\" (UniqueName: \"kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.886596 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.886573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.886658 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.886573    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.894013 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.893986    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drtrm\" (UniqueName: \"kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm\") pod \"payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") " pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:30.894132 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.894093    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spzvf\" (UniqueName: \"kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf\") pod \"payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:30.953452 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:30.953430    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:31.014616 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.014590    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:31.047644 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.047605    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:31.100713 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.100681    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:52:31.101758 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:52:31.101728    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod596d8114_9f47_4cef_808f_acc14f7d1876.slice/crio-be517127b4b03d78e4252af8041b5361094140473a0991396e374dc28f2af383 WatchSource:0}: Error finding container be517127b4b03d78e4252af8041b5361094140473a0991396e374dc28f2af383: Status 404 returned error can't find the container with id be517127b4b03d78e4252af8041b5361094140473a0991396e374dc28f2af383
Aug 04 15:52:31.103352 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.103331    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 15:52:31.173186 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.173149    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:52:31.173421 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:52:31.173392    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7665c54f_7021_4270_917d_4c7e1fce4be8.slice/crio-b859410e9478c6d2b7892a1257f3fb4ec568d431eb1a168c8a6d42cfea773f95 WatchSource:0}: Error finding container b859410e9478c6d2b7892a1257f3fb4ec568d431eb1a168c8a6d42cfea773f95: Status 404 returned error can't find the container with id b859410e9478c6d2b7892a1257f3fb4ec568d431eb1a168c8a6d42cfea773f95
Aug 04 15:52:31.212688 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.212658    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:52:31.213403 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:52:31.213370    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3921d7c_fb73_48cf_8cb5_04656f30115a.slice/crio-dbf00773761dccf0ad662e9b5b217d66ef6e77deab43320b2263be13b51a1f7c WatchSource:0}: Error finding container dbf00773761dccf0ad662e9b5b217d66ef6e77deab43320b2263be13b51a1f7c: Status 404 returned error can't find the container with id dbf00773761dccf0ad662e9b5b217d66ef6e77deab43320b2263be13b51a1f7c
Aug 04 15:52:31.937222 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.937184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" event={"ID":"7665c54f-7021-4270-917d-4c7e1fce4be8","Type":"ContainerStarted","Data":"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"}
Aug 04 15:52:31.937407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.937252    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" event={"ID":"7665c54f-7021-4270-917d-4c7e1fce4be8","Type":"ContainerStarted","Data":"b859410e9478c6d2b7892a1257f3fb4ec568d431eb1a168c8a6d42cfea773f95"}
Aug 04 15:52:31.937407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.937283    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:31.939107 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.939080    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" event={"ID":"c3921d7c-fb73-48cf-8cb5-04656f30115a","Type":"ContainerStarted","Data":"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"}
Aug 04 15:52:31.939241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.939137    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:31.939241 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.939162    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" event={"ID":"c3921d7c-fb73-48cf-8cb5-04656f30115a","Type":"ContainerStarted","Data":"dbf00773761dccf0ad662e9b5b217d66ef6e77deab43320b2263be13b51a1f7c"}
Aug 04 15:52:31.940971 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.940949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" event={"ID":"596d8114-9f47-4cef-808f-acc14f7d1876","Type":"ContainerStarted","Data":"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"}
Aug 04 15:52:31.941074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.940992    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" event={"ID":"596d8114-9f47-4cef-808f-acc14f7d1876","Type":"ContainerStarted","Data":"be517127b4b03d78e4252af8041b5361094140473a0991396e374dc28f2af383"}
Aug 04 15:52:31.941074 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.941025    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:31.960518 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.960480    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" podStartSLOduration=1.960468529 podStartE2EDuration="1.960468529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:52:31.95981163 +0000 UTC m=+2744.791779745" watchObservedRunningTime="2026-08-04 15:52:31.960468529 +0000 UTC m=+2744.792436637"
Aug 04 15:52:31.983723 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:31.983543    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" podStartSLOduration=1.329972492 podStartE2EDuration="1.98352818s" totalImagesPullingTime="653.555688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:52:31.983451144 +0000 UTC m=+2744.815419261" watchObservedRunningTime="2026-08-04 15:52:31.98352818 +0000 UTC m=+2744.815496298"
Aug 04 15:52:32.004376 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:32.004343    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" podStartSLOduration=2.004283661 podStartE2EDuration="2.004283661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:52:32.003244213 +0000 UTC m=+2744.835212330" watchObservedRunningTime="2026-08-04 15:52:32.004283661 +0000 UTC m=+2744.836251788"
Aug 04 15:52:37.952870 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:37.952815    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:52:42.949407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:42.949223    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:52:42.949879 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:42.949417    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:52:54.021166 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:54.021134    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:54.552920 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:54.552882    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:54.890183 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:54.890155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:55.122878 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:55.122822    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:58.149364 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:58.149332    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:58.243682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:58.243656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:59.277855 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.277826    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:52:59.281276 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.281259    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.285359 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.285336    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-df124e-serving-cert\""
Aug 04 15:52:59.297552 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.297529    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:52:59.341052 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.341030    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.341151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.341104    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqzc\" (UniqueName: \"kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.341151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.341134    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.342175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.342152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:59.442447 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.442420    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqzc\" (UniqueName: \"kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.442542 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.442460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.442542 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.442499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.442637 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:59.442616    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-serving-cert: secret "maas-api-e2e-api-b-df124e-serving-cert" not found
Aug 04 15:52:59.442681 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:52:59.442668    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls podName:6859c7fe-9088-471b-81eb-d58b346d055e nodeName:}" failed. No retries permitted until 2026-08-04 15:52:59.942654316 +0000 UTC m=+2772.774622414 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls") pod "maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" (UID: "6859c7fe-9088-471b-81eb-d58b346d055e") : secret "maas-api-e2e-api-b-df124e-serving-cert" not found
Aug 04 15:52:59.443052 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.443035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.451832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.451811    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqzc\" (UniqueName: \"kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.819431 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.819401    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:59.917661 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.917633    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:52:59.921545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.921523    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:52:59.921691 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.921656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:52:59.925762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.925742    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-df124e-dockercfg-vkdcf\""
Aug 04 15:52:59.925877 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.925858    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-df124e\""
Aug 04 15:52:59.938235 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.938206    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:52:59.947170 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.947143    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr25s\" (UniqueName: \"kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:52:59.947308 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.947269    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.947464 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.947430    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:52:59.949339 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.949317    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:52:59.950441 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.950410    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") pod \"maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:52:59.952627 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.952612    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:52:59.963760 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:52:59.963736    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:53:00.048333 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.048307    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdqtn\" (UniqueName: \"kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.048434 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.048357    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:00.048434 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.048399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr25s\" (UniqueName: \"kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:00.048555 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.048437    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.048979 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.048961    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:00.057271 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.057241    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr25s\" (UniqueName: \"kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s\") pod \"payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:00.149369 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.149339    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdqtn\" (UniqueName: \"kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.149488 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.149403    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.150117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.150098    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.157816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.157790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdqtn\" (UniqueName: \"kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn\") pod \"payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") " pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.191503 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.191479    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:53:00.234301 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.234251    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:00.270459 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.270411    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:00.360431 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.360395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:53:00.361828 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:53:00.361798    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6859c7fe_9088_471b_81eb_d58b346d055e.slice/crio-76706f6e14f3caf0c771d2289b95ca57baae7fe2570b9fbca79b6153fed3d702 WatchSource:0}: Error finding container 76706f6e14f3caf0c771d2289b95ca57baae7fe2570b9fbca79b6153fed3d702: Status 404 returned error can't find the container with id 76706f6e14f3caf0c771d2289b95ca57baae7fe2570b9fbca79b6153fed3d702
Aug 04 15:53:00.427486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.427447    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:53:00.428825 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:53:00.428775    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3239655_057d_421f_be5f_ed3eedd23015.slice/crio-b6e0a7f9a5d1142cd444ec4fbdec3f20c043f5f4d41ae2f847bb243faea7e79a WatchSource:0}: Error finding container b6e0a7f9a5d1142cd444ec4fbdec3f20c043f5f4d41ae2f847bb243faea7e79a: Status 404 returned error can't find the container with id b6e0a7f9a5d1142cd444ec4fbdec3f20c043f5f4d41ae2f847bb243faea7e79a
Aug 04 15:53:00.661335 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:00.661305    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:53:00.666535 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:53:00.663643    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod854a15ca_b556_49d9_b7e0_9b184f0b8eed.slice/crio-909e6e5722a10ab341b2271c91152980f8271ab5cd585db190a2aac7810378fc WatchSource:0}: Error finding container 909e6e5722a10ab341b2271c91152980f8271ab5cd585db190a2aac7810378fc: Status 404 returned error can't find the container with id 909e6e5722a10ab341b2271c91152980f8271ab5cd585db190a2aac7810378fc
Aug 04 15:53:01.094340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.094239    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" event={"ID":"f3239655-057d-421f-be5f-ed3eedd23015","Type":"ContainerStarted","Data":"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"}
Aug 04 15:53:01.094340 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.094314    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" event={"ID":"f3239655-057d-421f-be5f-ed3eedd23015","Type":"ContainerStarted","Data":"b6e0a7f9a5d1142cd444ec4fbdec3f20c043f5f4d41ae2f847bb243faea7e79a"}
Aug 04 15:53:01.094539 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.094344    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:01.095770 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.095742    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" event={"ID":"6859c7fe-9088-471b-81eb-d58b346d055e","Type":"ContainerStarted","Data":"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"}
Aug 04 15:53:01.095911 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.095793    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" event={"ID":"6859c7fe-9088-471b-81eb-d58b346d055e","Type":"ContainerStarted","Data":"76706f6e14f3caf0c771d2289b95ca57baae7fe2570b9fbca79b6153fed3d702"}
Aug 04 15:53:01.095911 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.095825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:53:01.097326 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.097301    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" event={"ID":"854a15ca-b556-49d9-b7e0-9b184f0b8eed","Type":"ContainerStarted","Data":"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"}
Aug 04 15:53:01.097397 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.097346    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" event={"ID":"854a15ca-b556-49d9-b7e0-9b184f0b8eed","Type":"ContainerStarted","Data":"909e6e5722a10ab341b2271c91152980f8271ab5cd585db190a2aac7810378fc"}
Aug 04 15:53:01.097435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.097396    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:01.112381 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.112341    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" podStartSLOduration=2.112328208 podStartE2EDuration="2.112328208s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:53:01.110718751 +0000 UTC m=+2773.942686868" watchObservedRunningTime="2026-08-04 15:53:01.112328208 +0000 UTC m=+2773.944296324"
Aug 04 15:53:01.130402 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.130358    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" podStartSLOduration=1.739748931 podStartE2EDuration="2.130348385s" totalImagesPullingTime="390.599454ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:53:01.128166451 +0000 UTC m=+2773.960134563" watchObservedRunningTime="2026-08-04 15:53:01.130348385 +0000 UTC m=+2773.962316501"
Aug 04 15:53:01.146521 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:01.146476    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" podStartSLOduration=2.146459387 podStartE2EDuration="2.146459387s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:53:01.144092309 +0000 UTC m=+2773.976060433" watchObservedRunningTime="2026-08-04 15:53:01.146459387 +0000 UTC m=+2773.978427505"
Aug 04 15:53:07.109249 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:07.109219    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:53:12.105332 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:12.105253    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:53:12.105673 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:12.105345    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:53:23.162993 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:23.162964    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:37.682492 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:37.682458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:41.895908 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.895869    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:53:41.898278 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.896129    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" podUID="596d8114-9f47-4cef-808f-acc14f7d1876" containerName="maas-api" containerID="cri-o://498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394" gracePeriod=30
Aug 04 15:53:41.947260 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.947231    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:53:41.947471 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.947432    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" podUID="c3921d7c-fb73-48cf-8cb5-04656f30115a" containerName="payload-processing" containerID="cri-o://ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553" gracePeriod=30
Aug 04 15:53:41.954319 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.954272    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:53:41.954711 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.954677    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" podUID="7665c54f-7021-4270-917d-4c7e1fce4be8" containerName="payload-pre-processing" containerID="cri-o://1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b" gracePeriod=30
Aug 04 15:53:41.992829 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:41.992797    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:42.093230 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.093157    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:42.156780 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.156742    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:42.241214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.241186    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:53:42.244708 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.244689    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:53:42.250363 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.250343    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:53:42.319606 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.319579    2571 generic.go:356] "Generic (PLEG): container finished" podID="7665c54f-7021-4270-917d-4c7e1fce4be8" containerID="1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b" exitCode=0
Aug 04 15:53:42.319736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.319616    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"
Aug 04 15:53:42.319736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.319661    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" event={"ID":"7665c54f-7021-4270-917d-4c7e1fce4be8","Type":"ContainerDied","Data":"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"}
Aug 04 15:53:42.319736 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.319732    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k" event={"ID":"7665c54f-7021-4270-917d-4c7e1fce4be8","Type":"ContainerDied","Data":"b859410e9478c6d2b7892a1257f3fb4ec568d431eb1a168c8a6d42cfea773f95"}
Aug 04 15:53:42.319880 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.319762    2571 scope.go:117] "RemoveContainer" containerID="1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"
Aug 04 15:53:42.320945 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.320920    2571 generic.go:356] "Generic (PLEG): container finished" podID="c3921d7c-fb73-48cf-8cb5-04656f30115a" containerID="ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553" exitCode=0
Aug 04 15:53:42.321069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.320956    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"
Aug 04 15:53:42.321069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.320998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" event={"ID":"c3921d7c-fb73-48cf-8cb5-04656f30115a","Type":"ContainerDied","Data":"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"}
Aug 04 15:53:42.321069 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.321043    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz" event={"ID":"c3921d7c-fb73-48cf-8cb5-04656f30115a","Type":"ContainerDied","Data":"dbf00773761dccf0ad662e9b5b217d66ef6e77deab43320b2263be13b51a1f7c"}
Aug 04 15:53:42.322407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.322384    2571 generic.go:356] "Generic (PLEG): container finished" podID="596d8114-9f47-4cef-808f-acc14f7d1876" containerID="498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394" exitCode=0
Aug 04 15:53:42.322499 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.322411    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"
Aug 04 15:53:42.322499 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.322430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" event={"ID":"596d8114-9f47-4cef-808f-acc14f7d1876","Type":"ContainerDied","Data":"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"}
Aug 04 15:53:42.322499 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.322474    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht" event={"ID":"596d8114-9f47-4cef-808f-acc14f7d1876","Type":"ContainerDied","Data":"be517127b4b03d78e4252af8041b5361094140473a0991396e374dc28f2af383"}
Aug 04 15:53:42.330676 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.330492    2571 scope.go:117] "RemoveContainer" containerID="1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"
Aug 04 15:53:42.331461 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:53:42.331435    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b\": container with ID starting with 1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b not found: ID does not exist" containerID="1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"
Aug 04 15:53:42.331545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.331472    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b"} err="failed to get container status \"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b\": rpc error: code = NotFound desc = could not find container \"1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b\": container with ID starting with 1cc65a412b7918516ab79ac5c784c2c54d5403ba64ddec8f183a05646a27531b not found: ID does not exist"
Aug 04 15:53:42.331545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.331493    2571 scope.go:117] "RemoveContainer" containerID="ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"
Aug 04 15:53:42.339238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.339223    2571 scope.go:117] "RemoveContainer" containerID="ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"
Aug 04 15:53:42.339509 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:53:42.339490    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553\": container with ID starting with ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553 not found: ID does not exist" containerID="ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"
Aug 04 15:53:42.339574 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.339515    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553"} err="failed to get container status \"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553\": rpc error: code = NotFound desc = could not find container \"ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553\": container with ID starting with ac04c4add5ac995eb694b410c05b3432fe498e9df3e45c18b875314c977ad553 not found: ID does not exist"
Aug 04 15:53:42.339574 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.339531    2571 scope.go:117] "RemoveContainer" containerID="498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"
Aug 04 15:53:42.346519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.346500    2571 scope.go:117] "RemoveContainer" containerID="498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"
Aug 04 15:53:42.346774 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:53:42.346756    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394\": container with ID starting with 498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394 not found: ID does not exist" containerID="498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"
Aug 04 15:53:42.346832 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.346780    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394"} err="failed to get container status \"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394\": rpc error: code = NotFound desc = could not find container \"498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394\": container with ID starting with 498f0f48b9199a6fbe5907ae3b82c033c6baae676157b8be6dcc04bab16f0394 not found: ID does not exist"
Aug 04 15:53:42.407083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407038    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") pod \"596d8114-9f47-4cef-808f-acc14f7d1876\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") "
Aug 04 15:53:42.407178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407103    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca\") pod \"596d8114-9f47-4cef-808f-acc14f7d1876\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") "
Aug 04 15:53:42.407178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407151    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume\") pod \"c3921d7c-fb73-48cf-8cb5-04656f30115a\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") "
Aug 04 15:53:42.407178 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407173    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume\") pod \"7665c54f-7021-4270-917d-4c7e1fce4be8\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") "
Aug 04 15:53:42.407358 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407208    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vggtf\" (UniqueName: \"kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf\") pod \"596d8114-9f47-4cef-808f-acc14f7d1876\" (UID: \"596d8114-9f47-4cef-808f-acc14f7d1876\") "
Aug 04 15:53:42.407358 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407238    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spzvf\" (UniqueName: \"kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf\") pod \"7665c54f-7021-4270-917d-4c7e1fce4be8\" (UID: \"7665c54f-7021-4270-917d-4c7e1fce4be8\") "
Aug 04 15:53:42.407358 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407326    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drtrm\" (UniqueName: \"kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm\") pod \"c3921d7c-fb73-48cf-8cb5-04656f30115a\" (UID: \"c3921d7c-fb73-48cf-8cb5-04656f30115a\") "
Aug 04 15:53:42.407603 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407575    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3921d7c-fb73-48cf-8cb5-04656f30115a" (UID: "c3921d7c-fb73-48cf-8cb5-04656f30115a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:53:42.407876 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407837    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "596d8114-9f47-4cef-808f-acc14f7d1876" (UID: "596d8114-9f47-4cef-808f-acc14f7d1876"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:53:42.408010 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.407983    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7665c54f-7021-4270-917d-4c7e1fce4be8" (UID: "7665c54f-7021-4270-917d-4c7e1fce4be8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:53:42.409319 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.409271    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "596d8114-9f47-4cef-808f-acc14f7d1876" (UID: "596d8114-9f47-4cef-808f-acc14f7d1876"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:53:42.409666 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.409642    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm" (OuterVolumeSpecName: "kube-api-access-drtrm") pod "c3921d7c-fb73-48cf-8cb5-04656f30115a" (UID: "c3921d7c-fb73-48cf-8cb5-04656f30115a"). InnerVolumeSpecName "kube-api-access-drtrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:53:42.409820 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.409796    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf" (OuterVolumeSpecName: "kube-api-access-spzvf") pod "7665c54f-7021-4270-917d-4c7e1fce4be8" (UID: "7665c54f-7021-4270-917d-4c7e1fce4be8"). InnerVolumeSpecName "kube-api-access-spzvf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:53:42.409872 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.409829    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf" (OuterVolumeSpecName: "kube-api-access-vggtf") pod "596d8114-9f47-4cef-808f-acc14f7d1876" (UID: "596d8114-9f47-4cef-808f-acc14f7d1876"). InnerVolumeSpecName "kube-api-access-vggtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:53:42.504283 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.504260    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:42.508615 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508596    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drtrm\" (UniqueName: \"kubernetes.io/projected/c3921d7c-fb73-48cf-8cb5-04656f30115a-kube-api-access-drtrm\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508619    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/596d8114-9f47-4cef-808f-acc14f7d1876-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508629    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/596d8114-9f47-4cef-808f-acc14f7d1876-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508637    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3921d7c-fb73-48cf-8cb5-04656f30115a-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508646    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7665c54f-7021-4270-917d-4c7e1fce4be8-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508654    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vggtf\" (UniqueName: \"kubernetes.io/projected/596d8114-9f47-4cef-808f-acc14f7d1876-kube-api-access-vggtf\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.508678 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.508661    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spzvf\" (UniqueName: \"kubernetes.io/projected/7665c54f-7021-4270-917d-4c7e1fce4be8-kube-api-access-spzvf\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:53:42.650879 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.650851    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:53:42.655611 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.655591    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bac88d-599f9cd948-pgj2k"]
Aug 04 15:53:42.669185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.669130    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:53:42.671131 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.671112    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bac88d-6675578cdb-sm9ht"]
Aug 04 15:53:42.681404 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.681384    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:53:42.686185 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:42.686167    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bac88d-7bb469dfb8-gzbtz"]
Aug 04 15:53:43.724904 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:43.724866    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="596d8114-9f47-4cef-808f-acc14f7d1876" path="/var/lib/kubelet/pods/596d8114-9f47-4cef-808f-acc14f7d1876/volumes"
Aug 04 15:53:43.725323 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:43.725250    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7665c54f-7021-4270-917d-4c7e1fce4be8" path="/var/lib/kubelet/pods/7665c54f-7021-4270-917d-4c7e1fce4be8/volumes"
Aug 04 15:53:43.725629 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:43.725611    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3921d7c-fb73-48cf-8cb5-04656f30115a" path="/var/lib/kubelet/pods/c3921d7c-fb73-48cf-8cb5-04656f30115a/volumes"
Aug 04 15:53:48.506919 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:48.506886    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:48.602912 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:48.602888    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:48.830043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:48.829981    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:49.079234 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:49.079204    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:51.731164 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:51.731129    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:53:51.834731 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:53:51.834698    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:04.655677 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.655646    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:54:04.656083 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.655885    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" podUID="6859c7fe-9088-471b-81eb-d58b346d055e" containerName="maas-api" containerID="cri-o://42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93" gracePeriod=30
Aug 04 15:54:04.682927 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.682906    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:04.708071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.708048    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:54:04.708274 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.708250    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" podUID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" containerName="payload-processing" containerID="cri-o://235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3" gracePeriod=30
Aug 04 15:54:04.715705 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.715678    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:54:04.716034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.716001    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" podUID="f3239655-057d-421f-be5f-ed3eedd23015" containerName="payload-pre-processing" containerID="cri-o://aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55" gracePeriod=30
Aug 04 15:54:04.782842 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.782818    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:04.871130 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.871091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:04.940467 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.940439    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:04.981388 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.981351    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:54:04.984947 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.984921    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:54:04.995694 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.995674    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdqtn\" (UniqueName: \"kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn\") pod \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") "
Aug 04 15:54:04.995786 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.995709    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcqzc\" (UniqueName: \"kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc\") pod \"6859c7fe-9088-471b-81eb-d58b346d055e\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") "
Aug 04 15:54:04.995833 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.995796    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca\") pod \"6859c7fe-9088-471b-81eb-d58b346d055e\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") "
Aug 04 15:54:04.995833 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.995829    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") pod \"6859c7fe-9088-471b-81eb-d58b346d055e\" (UID: \"6859c7fe-9088-471b-81eb-d58b346d055e\") "
Aug 04 15:54:04.995924 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.995850    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume\") pod \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\" (UID: \"854a15ca-b556-49d9-b7e0-9b184f0b8eed\") "
Aug 04 15:54:04.996186 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.996164    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6859c7fe-9088-471b-81eb-d58b346d055e" (UID: "6859c7fe-9088-471b-81eb-d58b346d055e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:54:04.996281 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.996260    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "854a15ca-b556-49d9-b7e0-9b184f0b8eed" (UID: "854a15ca-b556-49d9-b7e0-9b184f0b8eed"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:54:04.997965 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.997943    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6859c7fe-9088-471b-81eb-d58b346d055e" (UID: "6859c7fe-9088-471b-81eb-d58b346d055e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 15:54:04.998203 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.998184    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc" (OuterVolumeSpecName: "kube-api-access-rcqzc") pod "6859c7fe-9088-471b-81eb-d58b346d055e" (UID: "6859c7fe-9088-471b-81eb-d58b346d055e"). InnerVolumeSpecName "kube-api-access-rcqzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:54:04.998320 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:04.998236    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn" (OuterVolumeSpecName: "kube-api-access-gdqtn") pod "854a15ca-b556-49d9-b7e0-9b184f0b8eed" (UID: "854a15ca-b556-49d9-b7e0-9b184f0b8eed"). InnerVolumeSpecName "kube-api-access-gdqtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:54:05.006519 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.006496    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:54:05.096444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096418    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wr25s\" (UniqueName: \"kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s\") pod \"f3239655-057d-421f-be5f-ed3eedd23015\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") "
Aug 04 15:54:05.096569 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096478    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume\") pod \"f3239655-057d-421f-be5f-ed3eedd23015\" (UID: \"f3239655-057d-421f-be5f-ed3eedd23015\") "
Aug 04 15:54:05.096766 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096742    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3239655-057d-421f-be5f-ed3eedd23015" (UID: "f3239655-057d-421f-be5f-ed3eedd23015"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 15:54:05.096826 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096811    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6859c7fe-9088-471b-81eb-d58b346d055e-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.096867 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096830    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6859c7fe-9088-471b-81eb-d58b346d055e-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.096867 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096839    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/854a15ca-b556-49d9-b7e0-9b184f0b8eed-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.096867 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096848    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdqtn\" (UniqueName: \"kubernetes.io/projected/854a15ca-b556-49d9-b7e0-9b184f0b8eed-kube-api-access-gdqtn\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.096867 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.096857    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcqzc\" (UniqueName: \"kubernetes.io/projected/6859c7fe-9088-471b-81eb-d58b346d055e-kube-api-access-rcqzc\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.098347 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.098329    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s" (OuterVolumeSpecName: "kube-api-access-wr25s") pod "f3239655-057d-421f-be5f-ed3eedd23015" (UID: "f3239655-057d-421f-be5f-ed3eedd23015"). InnerVolumeSpecName "kube-api-access-wr25s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 15:54:05.197505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.197448    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wr25s\" (UniqueName: \"kubernetes.io/projected/f3239655-057d-421f-be5f-ed3eedd23015-kube-api-access-wr25s\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.197505 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.197468    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3239655-057d-421f-be5f-ed3eedd23015-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 15:54:05.265021 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.264998    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:05.447939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.447878    2571 generic.go:356] "Generic (PLEG): container finished" podID="f3239655-057d-421f-be5f-ed3eedd23015" containerID="aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55" exitCode=0
Aug 04 15:54:05.447939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.447922    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"
Aug 04 15:54:05.448063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.447962    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" event={"ID":"f3239655-057d-421f-be5f-ed3eedd23015","Type":"ContainerDied","Data":"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"}
Aug 04 15:54:05.448063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.448010    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v" event={"ID":"f3239655-057d-421f-be5f-ed3eedd23015","Type":"ContainerDied","Data":"b6e0a7f9a5d1142cd444ec4fbdec3f20c043f5f4d41ae2f847bb243faea7e79a"}
Aug 04 15:54:05.448063 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.448037    2571 scope.go:117] "RemoveContainer" containerID="aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"
Aug 04 15:54:05.449194 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.449131    2571 generic.go:356] "Generic (PLEG): container finished" podID="6859c7fe-9088-471b-81eb-d58b346d055e" containerID="42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93" exitCode=0
Aug 04 15:54:05.449194 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.449173    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"
Aug 04 15:54:05.449360 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.449227    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" event={"ID":"6859c7fe-9088-471b-81eb-d58b346d055e","Type":"ContainerDied","Data":"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"}
Aug 04 15:54:05.449360 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.449267    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9" event={"ID":"6859c7fe-9088-471b-81eb-d58b346d055e","Type":"ContainerDied","Data":"76706f6e14f3caf0c771d2289b95ca57baae7fe2570b9fbca79b6153fed3d702"}
Aug 04 15:54:05.450808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.450784    2571 generic.go:356] "Generic (PLEG): container finished" podID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" containerID="235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3" exitCode=0
Aug 04 15:54:05.450808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.450803    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" event={"ID":"854a15ca-b556-49d9-b7e0-9b184f0b8eed","Type":"ContainerDied","Data":"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"}
Aug 04 15:54:05.450808 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.450829    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"
Aug 04 15:54:05.451096 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.450857    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9" event={"ID":"854a15ca-b556-49d9-b7e0-9b184f0b8eed","Type":"ContainerDied","Data":"909e6e5722a10ab341b2271c91152980f8271ab5cd585db190a2aac7810378fc"}
Aug 04 15:54:05.457103 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.457079    2571 scope.go:117] "RemoveContainer" containerID="aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"
Aug 04 15:54:05.457416 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:54:05.457396    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55\": container with ID starting with aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55 not found: ID does not exist" containerID="aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"
Aug 04 15:54:05.457507 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.457422    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55"} err="failed to get container status \"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55\": rpc error: code = NotFound desc = could not find container \"aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55\": container with ID starting with aa7462ad7f84e7394f87356f2a1b2b27d310bc24bee8920f50028eb65eb5ee55 not found: ID does not exist"
Aug 04 15:54:05.457507 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.457445    2571 scope.go:117] "RemoveContainer" containerID="42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"
Aug 04 15:54:05.465967 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.465952    2571 scope.go:117] "RemoveContainer" containerID="42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"
Aug 04 15:54:05.466198 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:54:05.466181    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93\": container with ID starting with 42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93 not found: ID does not exist" containerID="42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"
Aug 04 15:54:05.466246 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.466204    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93"} err="failed to get container status \"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93\": rpc error: code = NotFound desc = could not find container \"42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93\": container with ID starting with 42907f09107f9aa64455cc3fc560639dd2c00482064830790698902e18a8ff93 not found: ID does not exist"
Aug 04 15:54:05.466246 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.466220    2571 scope.go:117] "RemoveContainer" containerID="235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"
Aug 04 15:54:05.473964 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.473936    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:54:05.474484 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.474467    2571 scope.go:117] "RemoveContainer" containerID="235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"
Aug 04 15:54:05.474755 ip-10-0-136-138 kubenswrapper[2571]: E0804 15:54:05.474736    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3\": container with ID starting with 235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3 not found: ID does not exist" containerID="235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"
Aug 04 15:54:05.474805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.474761    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3"} err="failed to get container status \"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3\": rpc error: code = NotFound desc = could not find container \"235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3\": container with ID starting with 235b5171127d41b785891b114d38653db8ecf183b6146fbba95e801a87af2ad3 not found: ID does not exist"
Aug 04 15:54:05.480414 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.480392    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df124e-755484bb4-g824v"]
Aug 04 15:54:05.492495 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.492471    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:54:05.503435 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.503407    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-df124e-79bcf84f7c-zd5v9"]
Aug 04 15:54:05.517950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.517926    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:54:05.522174 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.522154    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-df124e-6546ffcff4-b52r9"]
Aug 04 15:54:05.724116 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.724048    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6859c7fe-9088-471b-81eb-d58b346d055e" path="/var/lib/kubelet/pods/6859c7fe-9088-471b-81eb-d58b346d055e/volumes"
Aug 04 15:54:05.724608 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.724586    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" path="/var/lib/kubelet/pods/854a15ca-b556-49d9-b7e0-9b184f0b8eed/volumes"
Aug 04 15:54:05.724992 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:05.724973    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3239655-057d-421f-be5f-ed3eedd23015" path="/var/lib/kubelet/pods/f3239655-057d-421f-be5f-ed3eedd23015/volumes"
Aug 04 15:54:11.414333 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:11.414276    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:11.531660 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:11.531627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:11.693486 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:11.693408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:13.525129 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:13.525100    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:13.624816 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:13.624790    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:15.608983 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:15.608949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:15.700374 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:15.700326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:16.704117 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704086    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 15:54:16.704512 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704489    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7665c54f-7021-4270-917d-4c7e1fce4be8" containerName="payload-pre-processing"
Aug 04 15:54:16.704512 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704502    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="7665c54f-7021-4270-917d-4c7e1fce4be8" containerName="payload-pre-processing"
Aug 04 15:54:16.704512 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704513    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3921d7c-fb73-48cf-8cb5-04656f30115a" containerName="payload-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704519    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3921d7c-fb73-48cf-8cb5-04656f30115a" containerName="payload-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704530    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3239655-057d-421f-be5f-ed3eedd23015" containerName="payload-pre-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704537    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3239655-057d-421f-be5f-ed3eedd23015" containerName="payload-pre-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704546    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="596d8114-9f47-4cef-808f-acc14f7d1876" containerName="maas-api"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704551    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="596d8114-9f47-4cef-808f-acc14f7d1876" containerName="maas-api"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704560    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6859c7fe-9088-471b-81eb-d58b346d055e" containerName="maas-api"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704565    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6859c7fe-9088-471b-81eb-d58b346d055e" containerName="maas-api"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704576    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" containerName="payload-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704581    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" containerName="payload-processing"
Aug 04 15:54:16.704634 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704636    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="854a15ca-b556-49d9-b7e0-9b184f0b8eed" containerName="payload-processing"
Aug 04 15:54:16.704966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704643    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="7665c54f-7021-4270-917d-4c7e1fce4be8" containerName="payload-pre-processing"
Aug 04 15:54:16.704966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704650    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6859c7fe-9088-471b-81eb-d58b346d055e" containerName="maas-api"
Aug 04 15:54:16.704966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704657    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3921d7c-fb73-48cf-8cb5-04656f30115a" containerName="payload-processing"
Aug 04 15:54:16.704966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704664    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="596d8114-9f47-4cef-808f-acc14f7d1876" containerName="maas-api"
Aug 04 15:54:16.704966 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.704670    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3239655-057d-421f-be5f-ed3eedd23015" containerName="payload-pre-processing"
Aug 04 15:54:16.707744 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.707726    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.711882 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.711861    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-05b2bc-serving-cert\""
Aug 04 15:54:16.722815 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.722792    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 15:54:16.743477 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.743452    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:16.795712 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.795685    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhtf\" (UniqueName: \"kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.795818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.795726    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.795818 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.795805    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.888566 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.888537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:16.896399 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.896377    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.896482 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.896463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhtf\" (UniqueName: \"kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.896548 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.896484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.897043 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.897021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.898841 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.898818    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:16.905180 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:16.905162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhtf\" (UniqueName: \"kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf\") pod \"maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:17.017974 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.017919    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:17.155040 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.155019    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 15:54:17.157115 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:17.157086    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21296202_7f8f_473e_be15_df5a9ded36eb.slice/crio-18d177ee1c65b80d9541fec2aabf614027a7f6bf759d1107cbdffe9e32b2d7af WatchSource:0}: Error finding container 18d177ee1c65b80d9541fec2aabf614027a7f6bf759d1107cbdffe9e32b2d7af: Status 404 returned error can't find the container with id 18d177ee1c65b80d9541fec2aabf614027a7f6bf759d1107cbdffe9e32b2d7af
Aug 04 15:54:17.272010 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.271949    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:17.375525 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.375491    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 15:54:17.380175 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.380154    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.383157 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.383134    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-05b2bc-dockercfg-hlwp4\""
Aug 04 15:54:17.383405 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.383182    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-05b2bc\""
Aug 04 15:54:17.391845 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.391825    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 15:54:17.394738 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.394716    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 15:54:17.398801 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.398782    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.408939 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.408916    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 15:54:17.502101 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.502067    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.502248 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.502107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqnl9\" (UniqueName: \"kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.502248 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.502210    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.502348 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.502267    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q24dl\" (UniqueName: \"kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.518492 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.518461    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" event={"ID":"21296202-7f8f-473e-be15-df5a9ded36eb","Type":"ContainerStarted","Data":"18d177ee1c65b80d9541fec2aabf614027a7f6bf759d1107cbdffe9e32b2d7af"}
Aug 04 15:54:17.603316 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.603254    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.603429 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.603346    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q24dl\" (UniqueName: \"kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.603487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.603446    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.603487 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.603470    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqnl9\" (UniqueName: \"kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.604119 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.604096    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.604213 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.604170    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.615466 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.615445    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqnl9\" (UniqueName: \"kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9\") pod \"payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") " pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.615696 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.615674    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q24dl\" (UniqueName: \"kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl\") pod \"payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.693148 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.693114    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:17.711161 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.711138    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:17.863690 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:17.863662    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 15:54:17.865481 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:17.865447    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod774e58d2_7e31_43e6_852a_dacda4106285.slice/crio-751cbcaaf2dbefafb8b3ad9edc123ea34e297b379adbe1e9763d13ad8655d0ac WatchSource:0}: Error finding container 751cbcaaf2dbefafb8b3ad9edc123ea34e297b379adbe1e9763d13ad8655d0ac: Status 404 returned error can't find the container with id 751cbcaaf2dbefafb8b3ad9edc123ea34e297b379adbe1e9763d13ad8655d0ac
Aug 04 15:54:18.043559 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.043533    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 15:54:18.043928 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:18.043896    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d60736_e683_43d7_94b1_bae330fed23b.slice/crio-89974ca72f0a6acfe18a6d89163e20cd1fbe9a5a18a2d7b901eb9011c0419ad3 WatchSource:0}: Error finding container 89974ca72f0a6acfe18a6d89163e20cd1fbe9a5a18a2d7b901eb9011c0419ad3: Status 404 returned error can't find the container with id 89974ca72f0a6acfe18a6d89163e20cd1fbe9a5a18a2d7b901eb9011c0419ad3
Aug 04 15:54:18.524976 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.524942    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" event={"ID":"21296202-7f8f-473e-be15-df5a9ded36eb","Type":"ContainerStarted","Data":"108ea1fc239f39c0ecdbda70220fa9726389e43b06078bcc68e7f4927d2ffed6"}
Aug 04 15:54:18.525154 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.525092    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:18.526512 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.526481    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" event={"ID":"774e58d2-7e31-43e6-852a-dacda4106285","Type":"ContainerStarted","Data":"21f5d2ca9d2f1b6614585000cf2fbd2abbdd153e947fbdee023d9de9d7363b9c"}
Aug 04 15:54:18.526654 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.526529    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" event={"ID":"774e58d2-7e31-43e6-852a-dacda4106285","Type":"ContainerStarted","Data":"751cbcaaf2dbefafb8b3ad9edc123ea34e297b379adbe1e9763d13ad8655d0ac"}
Aug 04 15:54:18.526654 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.526557    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:18.527903 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.527879    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" event={"ID":"c1d60736-e683-43d7-94b1-bae330fed23b","Type":"ContainerStarted","Data":"6fa0a1b99d99e73d89aef22b692411fb7902925e98d98c8308cf79172c0395ea"}
Aug 04 15:54:18.528000 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.527918    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" event={"ID":"c1d60736-e683-43d7-94b1-bae330fed23b","Type":"ContainerStarted","Data":"89974ca72f0a6acfe18a6d89163e20cd1fbe9a5a18a2d7b901eb9011c0419ad3"}
Aug 04 15:54:18.528000 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.527956    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:18.545031 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.544981    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" podStartSLOduration=2.116878019 podStartE2EDuration="2.544964078s" totalImagesPullingTime="428.086059ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:18.544694519 +0000 UTC m=+2851.376662636" watchObservedRunningTime="2026-08-04 15:54:18.544964078 +0000 UTC m=+2851.376932198"
Aug 04 15:54:18.564762 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.564718    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" podStartSLOduration=1.564705386 podStartE2EDuration="1.564705386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:18.56193491 +0000 UTC m=+2851.393903025" watchObservedRunningTime="2026-08-04 15:54:18.564705386 +0000 UTC m=+2851.396673537"
Aug 04 15:54:18.583690 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.583645    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" podStartSLOduration=1.5836335990000001 podStartE2EDuration="1.583633599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:18.581946023 +0000 UTC m=+2851.413914140" watchObservedRunningTime="2026-08-04 15:54:18.583633599 +0000 UTC m=+2851.415601716"
Aug 04 15:54:18.799962 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:18.799902    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:24.539680 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:24.539641    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 15:54:29.536007 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:29.535968    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 15:54:29.536493 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:29.536052    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 15:54:40.693397 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:40.693322    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:43.875684 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:43.875650    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:44.749449 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:44.749418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:45.867732 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:45.867692    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 15:54:45.871508 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:45.871483    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:45.873214 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:45.873171    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:45.874630 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:45.874610    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-7b41f3-serving-cert\""
Aug 04 15:54:45.888662 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:45.888633    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 15:54:46.043608 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.043577    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.043805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.043646    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv52c\" (UniqueName: \"kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.043805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.043654    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:46.043805 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.043757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.144353 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.144319    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.144537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.144399    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.144537 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.144452    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv52c\" (UniqueName: \"kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.145058 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.145035    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.146725 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.146701    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.154658 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.154629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv52c\" (UniqueName: \"kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c\") pod \"maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.183422 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.183393    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:46.215545 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.215476    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:46.323151 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.323129    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 15:54:46.325040 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:46.325003    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21fa1ed2_9d05_4482_a6dc_8748c0d85b4a.slice/crio-1e5cbe4fa992c59b05795b8480a17b18f480883c717832d3e34eb5fd882e959c WatchSource:0}: Error finding container 1e5cbe4fa992c59b05795b8480a17b18f480883c717832d3e34eb5fd882e959c: Status 404 returned error can't find the container with id 1e5cbe4fa992c59b05795b8480a17b18f480883c717832d3e34eb5fd882e959c
Aug 04 15:54:46.558591 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.558516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:46.658391 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.658362    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:46.680052 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.680019    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" event={"ID":"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a","Type":"ContainerStarted","Data":"1e5cbe4fa992c59b05795b8480a17b18f480883c717832d3e34eb5fd882e959c"}
Aug 04 15:54:46.690570 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.690544    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 15:54:46.695357 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.695339    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.698270 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.698253    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-7b41f3-dockercfg-558ht\""
Aug 04 15:54:46.698533 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.698517    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-7b41f3\""
Aug 04 15:54:46.707437 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.707411    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 15:54:46.750733 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.750709    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 15:54:46.754407 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.754386    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.762501 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.762477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 15:54:46.852356 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.852256    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87sp\" (UniqueName: \"kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.852506 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.852354    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.852506 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.852473    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.852603 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.852511    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zv9qz\" (UniqueName: \"kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.953607 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.953575    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87sp\" (UniqueName: \"kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.953975 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.953634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.953975 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.953695    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.953975 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.953813    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zv9qz\" (UniqueName: \"kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.954354 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.954336    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.954444 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.954384    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:46.962807 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.962786    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zv9qz\" (UniqueName: \"kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz\") pod \"payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") " pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:46.962905 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:46.962828    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87sp\" (UniqueName: \"kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp\") pod \"payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:47.007034 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.007008    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:47.067578 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.067550    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:47.160862 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.160812    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 15:54:47.165728 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:47.165704    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf829215_165c_4789_950f_2ecd3d2260ad.slice/crio-398be42e3968cb68bcdf26c89be4c1711a57f0075e2c0865be69642b7abd3363 WatchSource:0}: Error finding container 398be42e3968cb68bcdf26c89be4c1711a57f0075e2c0865be69642b7abd3363: Status 404 returned error can't find the container with id 398be42e3968cb68bcdf26c89be4c1711a57f0075e2c0865be69642b7abd3363
Aug 04 15:54:47.230305 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.230264    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 15:54:47.230988 ip-10-0-136-138 kubenswrapper[2571]: W0804 15:54:47.230952    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc417145c_212b_49bd_8030_c887fac5d5bf.slice/crio-64d02fb2f04b50259cdd5cc7c0e4b9f1a1e8892911db7261da492e48b370ff6e WatchSource:0}: Error finding container 64d02fb2f04b50259cdd5cc7c0e4b9f1a1e8892911db7261da492e48b370ff6e: Status 404 returned error can't find the container with id 64d02fb2f04b50259cdd5cc7c0e4b9f1a1e8892911db7261da492e48b370ff6e
Aug 04 15:54:47.687483 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.687430    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" event={"ID":"c417145c-212b-49bd-8030-c887fac5d5bf","Type":"ContainerStarted","Data":"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"}
Aug 04 15:54:47.687682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.687560    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" event={"ID":"c417145c-212b-49bd-8030-c887fac5d5bf","Type":"ContainerStarted","Data":"64d02fb2f04b50259cdd5cc7c0e4b9f1a1e8892911db7261da492e48b370ff6e"}
Aug 04 15:54:47.687682 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.687599    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:54:47.688950 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.688925    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" event={"ID":"cf829215-165c-4789-950f-2ecd3d2260ad","Type":"ContainerStarted","Data":"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"}
Aug 04 15:54:47.689071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.688978    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:47.689071 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.689003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" event={"ID":"cf829215-165c-4789-950f-2ecd3d2260ad","Type":"ContainerStarted","Data":"398be42e3968cb68bcdf26c89be4c1711a57f0075e2c0865be69642b7abd3363"}
Aug 04 15:54:47.705741 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.705696    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" podStartSLOduration=1.705681207 podStartE2EDuration="1.705681207s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:47.704796762 +0000 UTC m=+2880.536764879" watchObservedRunningTime="2026-08-04 15:54:47.705681207 +0000 UTC m=+2880.537649361"
Aug 04 15:54:47.731864 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:47.731799    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" podStartSLOduration=1.731780425 podStartE2EDuration="1.731780425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:47.730540505 +0000 UTC m=+2880.562508625" watchObservedRunningTime="2026-08-04 15:54:47.731780425 +0000 UTC m=+2880.563748545"
Aug 04 15:54:48.695282 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:48.695241    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" event={"ID":"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a","Type":"ContainerStarted","Data":"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"}
Aug 04 15:54:48.695740 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:48.695696    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:48.718207 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:48.718149    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" podStartSLOduration=2.263707647 podStartE2EDuration="3.718130941s" totalImagesPullingTime="1.454423294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 15:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 15:54:48.714280667 +0000 UTC m=+2881.546248785" watchObservedRunningTime="2026-08-04 15:54:48.718130941 +0000 UTC m=+2881.550099058"
Aug 04 15:54:49.764670 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:49.764632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:54:55.711970 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:55.711937    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 15:54:58.697238 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:58.697207    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 15:54:58.697813 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:54:58.697793    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 15:55:10.297149 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:55:10.297088    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:55:11.726344 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:55:11.726305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:55:22.017929 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:55:22.017892    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:55:43.277582 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:55:43.277548    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:56:06.690403 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:56:06.690368    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 15:56:06.791600 ip-10-0-136-138 kubenswrapper[2571]: I0804 15:56:06.791569    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:00:44.041707 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:00:44.041630    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:00:49.734457 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:00:49.734417    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:00:55.859916 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:00:55.859885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:00:59.961118 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:00:59.961085    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:01:32.144931 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:01:32.144881    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:01:46.983652 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:01:46.983613    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:01:47.334212 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:01:47.334126    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:01:59.893802 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:01:59.893763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:11.433446 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:03:11.433416    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:12.235510 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:03:12.235483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:19.552180 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:03:19.552146    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:03:41.568048 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:03:41.567967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:30.079708 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:30.079666    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:30.697781 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:30.697746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:50.262960 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:50.262920    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:55.441573 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.441540    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:05:55.445232 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.445215    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.449269 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.449252    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e9e4ac-dockercfg-62nx2\""
Aug 04 16:05:55.449529 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.449515    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e9e4ac\""
Aug 04 16:05:55.465066 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.465045    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:05:55.518893 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.518870    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:05:55.522401 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.522387    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.534660 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.534638    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:05:55.542375 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.542348    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvs5d\" (UniqueName: \"kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.542480 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.542408    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.556241 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.556211    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:05:55.643955 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.643927    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvs5d\" (UniqueName: \"kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.644084 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.643963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.644084 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.644024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.644084 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.644060    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6c8kh\" (UniqueName: \"kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.644686 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.644666    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.653278 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.653253    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvs5d\" (UniqueName: \"kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d\") pod \"payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.745203 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.745142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6c8kh\" (UniqueName: \"kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.745334 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.745241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.745839 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.745821    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.754495 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.754474    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6c8kh\" (UniqueName: \"kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh\") pod \"payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.755232 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.755208    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:55.833846 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.833817    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:55.936718 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:55.936629    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:05:55.937396 ip-10-0-136-138 kubenswrapper[2571]: W0804 16:05:55.937364    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30a94a8_38a8_4642_aa45_554b0b859075.slice/crio-c63cb42dfd57323796cd0e3114aa4afd38714f8342aa300c17e7f054e378cd92 WatchSource:0}: Error finding container c63cb42dfd57323796cd0e3114aa4afd38714f8342aa300c17e7f054e378cd92: Status 404 returned error can't find the container with id c63cb42dfd57323796cd0e3114aa4afd38714f8342aa300c17e7f054e378cd92
Aug 04 16:05:56.189613 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.189588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:05:56.191504 ip-10-0-136-138 kubenswrapper[2571]: W0804 16:05:56.191473    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3d1beb5_88c6_4bec_af6d_eef28bc0d4b2.slice/crio-77e51ee0e0d3b9f8020f1a8adc0a2eaa68947c76463064651308508c3e92821f WatchSource:0}: Error finding container 77e51ee0e0d3b9f8020f1a8adc0a2eaa68947c76463064651308508c3e92821f: Status 404 returned error can't find the container with id 77e51ee0e0d3b9f8020f1a8adc0a2eaa68947c76463064651308508c3e92821f
Aug 04 16:05:56.308063 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.308002    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" event={"ID":"e30a94a8-38a8-4642-aa45-554b0b859075","Type":"ContainerStarted","Data":"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"}
Aug 04 16:05:56.308248 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.308092    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" event={"ID":"e30a94a8-38a8-4642-aa45-554b0b859075","Type":"ContainerStarted","Data":"c63cb42dfd57323796cd0e3114aa4afd38714f8342aa300c17e7f054e378cd92"}
Aug 04 16:05:56.308365 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.308247    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:05:56.309915 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.309894    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" event={"ID":"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2","Type":"ContainerStarted","Data":"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"}
Aug 04 16:05:56.310011 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.309930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" event={"ID":"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2","Type":"ContainerStarted","Data":"77e51ee0e0d3b9f8020f1a8adc0a2eaa68947c76463064651308508c3e92821f"}
Aug 04 16:05:56.310069 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.310016    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:05:56.327660 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.327616    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" podStartSLOduration=1.327600253 podStartE2EDuration="1.327600253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:56.326040443 +0000 UTC m=+3549.158008561" watchObservedRunningTime="2026-08-04 16:05:56.327600253 +0000 UTC m=+3549.159568370"
Aug 04 16:05:56.345787 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:05:56.345729    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" podStartSLOduration=1.345707706 podStartE2EDuration="1.345707706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:05:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:05:56.344911959 +0000 UTC m=+3549.176880080" watchObservedRunningTime="2026-08-04 16:05:56.345707706 +0000 UTC m=+3549.177675824"
Aug 04 16:06:07.318442 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:07.318341    2571 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.86:9004: connect: connection refused"
Aug 04 16:06:07.319139 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:07.319061    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:06:15.756023 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:15.755975    2571 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.86:9004: connect: connection refused"
Aug 04 16:06:17.318408 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:17.318373    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:06:18.548910 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:18.548871    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:19.259643 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:19.259604    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:19.576308 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:19.576186    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:20.068312 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:20.068268    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:27.344533 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:27.344495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:27.444428 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:27.444399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:28.590363 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.590327    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:06:28.594239 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.594216    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.599280 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.599255    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-d94d35-serving-cert\""
Aug 04 16:06:28.607082 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.607056    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:06:28.640354 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.640318    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:28.777759 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.777721    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.777759 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.777763    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cng7c\" (UniqueName: \"kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.778001 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.777860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.879207 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.879172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.879452 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.879373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.879452 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:06:28.879376    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-serving-cert: secret "maas-api-e2e-ipp-b-d94d35-serving-cert" not found
Aug 04 16:06:28.879575 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:06:28.879478    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls podName:6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa nodeName:}" failed. No retries permitted until 2026-08-04 16:06:29.379455836 +0000 UTC m=+3582.211423934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls") pod "maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" (UID: "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa") : secret "maas-api-e2e-ipp-b-d94d35-serving-cert" not found
Aug 04 16:06:28.879575 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.879505    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cng7c\" (UniqueName: \"kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.880061 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.880038    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:28.902050 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:28.902022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cng7c\" (UniqueName: \"kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:29.014890 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.014845    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:29.225044 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.224942    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:29.323308 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.323256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:29.385048 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.385011    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:29.387598 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.387574    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") pod \"maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:29.506793 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.506692    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:29.655055 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.655028    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:06:29.657793 ip-10-0-136-138 kubenswrapper[2571]: W0804 16:06:29.657747    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6055d5ff_b2dc_4d6b_acbe_20d6a305e5fa.slice/crio-a12ffc548dd99aaf5d50f11e1001374e96fa87958d2872987347792a72b36d21 WatchSource:0}: Error finding container a12ffc548dd99aaf5d50f11e1001374e96fa87958d2872987347792a72b36d21: Status 404 returned error can't find the container with id a12ffc548dd99aaf5d50f11e1001374e96fa87958d2872987347792a72b36d21
Aug 04 16:06:29.659285 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:29.659264    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 04 16:06:30.501249 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:30.501154    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" event={"ID":"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa","Type":"ContainerStarted","Data":"c85cfd0818a54ba793fe263ed679387ada1ad316f7afa15323bc8c0a26e1b82b"}
Aug 04 16:06:30.501249 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:30.501205    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" event={"ID":"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa","Type":"ContainerStarted","Data":"a12ffc548dd99aaf5d50f11e1001374e96fa87958d2872987347792a72b36d21"}
Aug 04 16:06:30.501527 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:30.501310    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:30.521870 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:30.521819    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" podStartSLOduration=1.9650763900000001 podStartE2EDuration="2.521802026s" totalImagesPullingTime="556.725636ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:06:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:06:30.520337427 +0000 UTC m=+3583.352305536" watchObservedRunningTime="2026-08-04 16:06:30.521802026 +0000 UTC m=+3583.353770142"
Aug 04 16:06:36.512967 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:36.512937    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:06:53.323772 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:53.323729    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:06:59.375805 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:06:59.375772    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"
Aug 04 16:07:06.728888 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:06.728855    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:54.621575 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:54.621540    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v_e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2/payload-processing/0.log"
Aug 04 16:07:54.753260 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:54.753227    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"
Aug 04 16:07:55.174424 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:55.174387    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:55.508670 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:55.508577    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:55.991144 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:55.991112    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:59.153165 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:59.153127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:59.253246 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:59.253202    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:07:59.954369 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:07:59.954326    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:00.207985 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.207866    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:00.632871 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.632831    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:00.728559 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.728524    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:00.814325 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.814273    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:00.818316 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.818267    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:00.821510 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.821489    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-cc2056-dockercfg-nrrj9\""
Aug 04 16:08:00.821655 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.821532    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-cc2056\""
Aug 04 16:08:00.835469 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.835445    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:00.961558 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.961464    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q9jkd\" (UniqueName: \"kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:00.961708 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:00.961607    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.062218 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.062180    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.062436 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.062352    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q9jkd\" (UniqueName: \"kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.063238 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.063209    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.073423 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.073403    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q9jkd\" (UniqueName: \"kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd\") pod \"payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.130115 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.130093    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:01.497700 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:01.497675    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:01.499516 ip-10-0-136-138 kubenswrapper[2571]: W0804 16:08:01.499488    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6ce13de_956c_4e6d_b0f9_b963754b8d9e.slice/crio-21d215bf6f93fdc369b2648ec134d8851533f2fe323fa5ed867af5471a3f16f8 WatchSource:0}: Error finding container 21d215bf6f93fdc369b2648ec134d8851533f2fe323fa5ed867af5471a3f16f8: Status 404 returned error can't find the container with id 21d215bf6f93fdc369b2648ec134d8851533f2fe323fa5ed867af5471a3f16f8
Aug 04 16:08:02.054272 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:02.054235    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" event={"ID":"d6ce13de-956c-4e6d-b0f9-b963754b8d9e","Type":"ContainerStarted","Data":"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"}
Aug 04 16:08:02.054477 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:02.054315    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" event={"ID":"d6ce13de-956c-4e6d-b0f9-b963754b8d9e","Type":"ContainerStarted","Data":"21d215bf6f93fdc369b2648ec134d8851533f2fe323fa5ed867af5471a3f16f8"}
Aug 04 16:08:02.054477 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:02.054345    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:02.074280 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:02.074227    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" podStartSLOduration=2.074205606 podStartE2EDuration="2.074205606s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-04 16:08:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:08:02.072670487 +0000 UTC m=+3674.904638605" watchObservedRunningTime="2026-08-04 16:08:02.074205606 +0000 UTC m=+3674.906173735"
Aug 04 16:08:13.069235 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:13.069151    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:21.324390 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:21.324344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:23.829633 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:23.829589    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:30.659261 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.659223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:30.740139 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.740105    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:30.740372 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.740342    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" podUID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" containerName="payload-pre-processing" containerID="cri-o://f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc" gracePeriod=30
Aug 04 16:08:30.810728 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.810699    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:30.947235 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.947207    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:30.997535 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:30.997515    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:31.049487 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.049454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:31.059395 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.059371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q9jkd\" (UniqueName: \"kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd\") pod \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") "
Aug 04 16:08:31.059506 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.059416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume\") pod \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\" (UID: \"d6ce13de-956c-4e6d-b0f9-b963754b8d9e\") "
Aug 04 16:08:31.059841 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.059818    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d6ce13de-956c-4e6d-b0f9-b963754b8d9e" (UID: "d6ce13de-956c-4e6d-b0f9-b963754b8d9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:31.061467 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.061445    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd" (OuterVolumeSpecName: "kube-api-access-q9jkd") pod "d6ce13de-956c-4e6d-b0f9-b963754b8d9e" (UID: "d6ce13de-956c-4e6d-b0f9-b963754b8d9e"). InnerVolumeSpecName "kube-api-access-q9jkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:31.160532 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.160481    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q9jkd\" (UniqueName: \"kubernetes.io/projected/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-kube-api-access-q9jkd\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.160532 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.160522    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d6ce13de-956c-4e6d-b0f9-b963754b8d9e-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:31.219857 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.219752    2571 generic.go:356] "Generic (PLEG): container finished" podID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" containerID="f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc" exitCode=0
Aug 04 16:08:31.219857 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.219810    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"
Aug 04 16:08:31.220069 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.219846    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" event={"ID":"d6ce13de-956c-4e6d-b0f9-b963754b8d9e","Type":"ContainerDied","Data":"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"}
Aug 04 16:08:31.220069 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.219924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn" event={"ID":"d6ce13de-956c-4e6d-b0f9-b963754b8d9e","Type":"ContainerDied","Data":"21d215bf6f93fdc369b2648ec134d8851533f2fe323fa5ed867af5471a3f16f8"}
Aug 04 16:08:31.220069 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.219948    2571 scope.go:117] "RemoveContainer" containerID="f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"
Aug 04 16:08:31.229790 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.229769    2571 scope.go:117] "RemoveContainer" containerID="f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"
Aug 04 16:08:31.230090 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:08:31.230068    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc\": container with ID starting with f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc not found: ID does not exist" containerID="f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"
Aug 04 16:08:31.230137 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.230100    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc"} err="failed to get container status \"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc\": rpc error: code = NotFound desc = could not find container \"f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc\": container with ID starting with f3d0d3e221c9881fe799fa939a39ed933c8ec08f3a1dd67e4b1f04e5b58719dc not found: ID does not exist"
Aug 04 16:08:31.258866 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.258837    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:31.271856 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.271830    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-cc2056-855957d884-dk6bn"]
Aug 04 16:08:31.460491 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.460458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:31.724705 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:31.724662    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" path="/var/lib/kubelet/pods/d6ce13de-956c-4e6d-b0f9-b963754b8d9e/volumes"
Aug 04 16:08:37.761175 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:37.761128    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:37.858787 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:37.858751    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:38.025907 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:38.025803    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:38.677214 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:38.677180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:57.534056 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.534018    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:08:57.534527 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.534207    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" podUID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" containerName="payload-processing" containerID="cri-o://ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4" gracePeriod=30
Aug 04 16:08:57.543778 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.543691    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:08:57.544155 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.544119    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing" containerID="cri-o://718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c" gracePeriod=30
Aug 04 16:08:57.793103 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.793042    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:57.797893 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.797871    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:08:57.829795 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.829772    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:08:57.897604 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.897573    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume\") pod \"e30a94a8-38a8-4642-aa45-554b0b859075\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") "
Aug 04 16:08:57.897732 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.897717    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fvs5d\" (UniqueName: \"kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d\") pod \"e30a94a8-38a8-4642-aa45-554b0b859075\" (UID: \"e30a94a8-38a8-4642-aa45-554b0b859075\") "
Aug 04 16:08:57.897794 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.897749    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6c8kh\" (UniqueName: \"kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh\") pod \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") "
Aug 04 16:08:57.897853 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.897814    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume\") pod \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\" (UID: \"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2\") "
Aug 04 16:08:57.897908 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.897877    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e30a94a8-38a8-4642-aa45-554b0b859075" (UID: "e30a94a8-38a8-4642-aa45-554b0b859075"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:57.898132 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.898112    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e30a94a8-38a8-4642-aa45-554b0b859075-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:57.898216 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.898197    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" (UID: "e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:08:57.899781 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.899757    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh" (OuterVolumeSpecName: "kube-api-access-6c8kh") pod "e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" (UID: "e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2"). InnerVolumeSpecName "kube-api-access-6c8kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:57.899878 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.899803    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d" (OuterVolumeSpecName: "kube-api-access-fvs5d") pod "e30a94a8-38a8-4642-aa45-554b0b859075" (UID: "e30a94a8-38a8-4642-aa45-554b0b859075"). InnerVolumeSpecName "kube-api-access-fvs5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:08:57.933243 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.933217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:57.998864 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.998844    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fvs5d\" (UniqueName: \"kubernetes.io/projected/e30a94a8-38a8-4642-aa45-554b0b859075-kube-api-access-fvs5d\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:57.998864 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.998866    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6c8kh\" (UniqueName: \"kubernetes.io/projected/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-kube-api-access-6c8kh\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:57.998991 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:57.998876    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:08:58.173342 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.173317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:08:58.370392 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.370356    2571 generic.go:356] "Generic (PLEG): container finished" podID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" containerID="ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4" exitCode=0
Aug 04 16:08:58.370521 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.370414    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"
Aug 04 16:08:58.370521 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.370459    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" event={"ID":"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2","Type":"ContainerDied","Data":"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"}
Aug 04 16:08:58.370633 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.370531    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v" event={"ID":"e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2","Type":"ContainerDied","Data":"77e51ee0e0d3b9f8020f1a8adc0a2eaa68947c76463064651308508c3e92821f"}
Aug 04 16:08:58.370633 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.370562    2571 scope.go:117] "RemoveContainer" containerID="ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"
Aug 04 16:08:58.372014 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.371989    2571 generic.go:356] "Generic (PLEG): container finished" podID="e30a94a8-38a8-4642-aa45-554b0b859075" containerID="718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c" exitCode=0
Aug 04 16:08:58.372118 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.372035    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" event={"ID":"e30a94a8-38a8-4642-aa45-554b0b859075","Type":"ContainerDied","Data":"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"}
Aug 04 16:08:58.372118 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.372063    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"
Aug 04 16:08:58.372118 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.372097    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d" event={"ID":"e30a94a8-38a8-4642-aa45-554b0b859075","Type":"ContainerDied","Data":"c63cb42dfd57323796cd0e3114aa4afd38714f8342aa300c17e7f054e378cd92"}
Aug 04 16:08:58.381512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.381492    2571 scope.go:117] "RemoveContainer" containerID="ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"
Aug 04 16:08:58.381826 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:08:58.381804    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4\": container with ID starting with ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4 not found: ID does not exist" containerID="ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"
Aug 04 16:08:58.381890 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.381836    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4"} err="failed to get container status \"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4\": rpc error: code = NotFound desc = could not find container \"ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4\": container with ID starting with ca21539163dd454cb4c3324f8a53a8d5565972dcd46e169b77b039eaa38664c4 not found: ID does not exist"
Aug 04 16:08:58.381890 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.381854    2571 scope.go:117] "RemoveContainer" containerID="718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"
Aug 04 16:08:58.393406 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.393380    2571 scope.go:117] "RemoveContainer" containerID="718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"
Aug 04 16:08:58.393693 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:08:58.393674    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c\": container with ID starting with 718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c not found: ID does not exist" containerID="718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"
Aug 04 16:08:58.393748 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.393700    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c"} err="failed to get container status \"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c\": rpc error: code = NotFound desc = could not find container \"718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c\": container with ID starting with 718c860cde672671204da8e79f04566a0e87a2621986826ee2f7536887c7216c not found: ID does not exist"
Aug 04 16:08:58.401912 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.401834    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:08:58.404563 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.404536    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e9e4ac-864c47565b-pgb7d"]
Aug 04 16:08:58.417135 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.417110    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:08:58.424020 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:58.423969    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e9e4ac-7d8f8d6b88-46t9v"]
Aug 04 16:08:59.725227 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:59.725193    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" path="/var/lib/kubelet/pods/e30a94a8-38a8-4642-aa45-554b0b859075/volumes"
Aug 04 16:08:59.725621 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:08:59.725569    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" path="/var/lib/kubelet/pods/e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2/volumes"
Aug 04 16:09:03.198967 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:03.198929    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:32.002624 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:32.002582    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:32.067608 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:32.067572    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:39.515187 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:39.515085    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:40.999901 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:40.999862    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:47.186000 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:47.185962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:47.286663 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:47.286613    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:47.569325 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:47.569232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:47.796973 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:47.796936    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:58.545365 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.545334    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:09:58.545780 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.545524    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" podUID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" containerName="maas-api" containerID="cri-o://c85cfd0818a54ba793fe263ed679387ada1ad316f7afa15323bc8c0a26e1b82b" gracePeriod=30
Aug 04 16:09:58.588137 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.588107    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:58.693766 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.693734    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:58.709493 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.709460    2571 generic.go:356] "Generic (PLEG): container finished" podID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" containerID="c85cfd0818a54ba793fe263ed679387ada1ad316f7afa15323bc8c0a26e1b82b" exitCode=0
Aug 04 16:09:58.709633 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.709539    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" event={"ID":"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa","Type":"ContainerDied","Data":"c85cfd0818a54ba793fe263ed679387ada1ad316f7afa15323bc8c0a26e1b82b"}
Aug 04 16:09:58.802733 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.802682    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:09:58.806458 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.806434    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:58.859396 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.859375    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca\") pod \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") "
Aug 04 16:09:58.859518 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.859416    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cng7c\" (UniqueName: \"kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c\") pod \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") "
Aug 04 16:09:58.859596 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.859582    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") pod \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\" (UID: \"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa\") "
Aug 04 16:09:58.859705 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.859682    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" (UID: "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:09:58.859901 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.859884    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:09:58.861472 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.861451    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" (UID: "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:09:58.861556 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.861515    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c" (OuterVolumeSpecName: "kube-api-access-cng7c") pod "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" (UID: "6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa"). InnerVolumeSpecName "kube-api-access-cng7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:09:58.961522 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.961495    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:09:58.961616 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.961526    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cng7c\" (UniqueName: \"kubernetes.io/projected/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa-kube-api-access-cng7c\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:09:58.963565 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:58.963542    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:59.286302 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.286266    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:09:59.715988 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.715965    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"
Aug 04 16:09:59.716421 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.715961    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r" event={"ID":"6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa","Type":"ContainerDied","Data":"a12ffc548dd99aaf5d50f11e1001374e96fa87958d2872987347792a72b36d21"}
Aug 04 16:09:59.716421 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.716103    2571 scope.go:117] "RemoveContainer" containerID="c85cfd0818a54ba793fe263ed679387ada1ad316f7afa15323bc8c0a26e1b82b"
Aug 04 16:09:59.741086 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.741062    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:09:59.745858 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:09:59.745826    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-d94d35-695c7459d5-pvc7r"]
Aug 04 16:10:01.724886 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:01.724847    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" path="/var/lib/kubelet/pods/6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa/volumes"
Aug 04 16:10:05.537700 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:05.537661    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:05.633467 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:05.633435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:05.855729 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:05.855628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:06.072460 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:06.072424    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:11.547450 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.547419    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 16:10:11.547900 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.547649    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" podUID="21296202-7f8f-473e-be15-df5a9ded36eb" containerName="maas-api" containerID="cri-o://108ea1fc239f39c0ecdbda70220fa9726389e43b06078bcc68e7f4927d2ffed6" gracePeriod=30
Aug 04 16:10:11.587751 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.587720    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:11.628082 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.628054    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 16:10:11.628358 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.628333    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" podUID="774e58d2-7e31-43e6-852a-dacda4106285" containerName="payload-processing" containerID="cri-o://21f5d2ca9d2f1b6614585000cf2fbd2abbdd153e947fbdee023d9de9d7363b9c" gracePeriod=30
Aug 04 16:10:11.634689 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.634663    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 16:10:11.634910 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.634867    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" podUID="c1d60736-e683-43d7-94b1-bae330fed23b" containerName="payload-pre-processing" containerID="cri-o://6fa0a1b99d99e73d89aef22b692411fb7902925e98d98c8308cf79172c0395ea" gracePeriod=30
Aug 04 16:10:11.681190 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.681127    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:11.781141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.781097    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:11.784793 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.784762    2571 generic.go:356] "Generic (PLEG): container finished" podID="774e58d2-7e31-43e6-852a-dacda4106285" containerID="21f5d2ca9d2f1b6614585000cf2fbd2abbdd153e947fbdee023d9de9d7363b9c" exitCode=0
Aug 04 16:10:11.784954 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.784848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" event={"ID":"774e58d2-7e31-43e6-852a-dacda4106285","Type":"ContainerDied","Data":"21f5d2ca9d2f1b6614585000cf2fbd2abbdd153e947fbdee023d9de9d7363b9c"}
Aug 04 16:10:11.786644 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.786617    2571 generic.go:356] "Generic (PLEG): container finished" podID="c1d60736-e683-43d7-94b1-bae330fed23b" containerID="6fa0a1b99d99e73d89aef22b692411fb7902925e98d98c8308cf79172c0395ea" exitCode=0
Aug 04 16:10:11.786774 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.786694    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" event={"ID":"c1d60736-e683-43d7-94b1-bae330fed23b","Type":"ContainerDied","Data":"6fa0a1b99d99e73d89aef22b692411fb7902925e98d98c8308cf79172c0395ea"}
Aug 04 16:10:11.788313 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.788246    2571 generic.go:356] "Generic (PLEG): container finished" podID="21296202-7f8f-473e-be15-df5a9ded36eb" containerID="108ea1fc239f39c0ecdbda70220fa9726389e43b06078bcc68e7f4927d2ffed6" exitCode=0
Aug 04 16:10:11.788421 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.788319    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" event={"ID":"21296202-7f8f-473e-be15-df5a9ded36eb","Type":"ContainerDied","Data":"108ea1fc239f39c0ecdbda70220fa9726389e43b06078bcc68e7f4927d2ffed6"}
Aug 04 16:10:11.887182 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.887156    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 16:10:11.907921 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.907796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:11.928727 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.928702    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 16:10:11.938260 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.938241    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 16:10:11.973866 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.973840    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca\") pod \"21296202-7f8f-473e-be15-df5a9ded36eb\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") "
Aug 04 16:10:11.973985 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.973940    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vhtf\" (UniqueName: \"kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf\") pod \"21296202-7f8f-473e-be15-df5a9ded36eb\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") "
Aug 04 16:10:11.974071 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.974049    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls\") pod \"21296202-7f8f-473e-be15-df5a9ded36eb\" (UID: \"21296202-7f8f-473e-be15-df5a9ded36eb\") "
Aug 04 16:10:11.974210 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.974188    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21296202-7f8f-473e-be15-df5a9ded36eb" (UID: "21296202-7f8f-473e-be15-df5a9ded36eb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:11.974486 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.974458    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21296202-7f8f-473e-be15-df5a9ded36eb-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:11.976045 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.976022    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21296202-7f8f-473e-be15-df5a9ded36eb" (UID: "21296202-7f8f-473e-be15-df5a9ded36eb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:10:11.976130 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:11.976070    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf" (OuterVolumeSpecName: "kube-api-access-2vhtf") pod "21296202-7f8f-473e-be15-df5a9ded36eb" (UID: "21296202-7f8f-473e-be15-df5a9ded36eb"). InnerVolumeSpecName "kube-api-access-2vhtf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:12.075109 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075051    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q24dl\" (UniqueName: \"kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl\") pod \"c1d60736-e683-43d7-94b1-bae330fed23b\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") "
Aug 04 16:10:12.075208 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075168    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume\") pod \"774e58d2-7e31-43e6-852a-dacda4106285\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") "
Aug 04 16:10:12.075272 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075211    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqnl9\" (UniqueName: \"kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9\") pod \"774e58d2-7e31-43e6-852a-dacda4106285\" (UID: \"774e58d2-7e31-43e6-852a-dacda4106285\") "
Aug 04 16:10:12.075408 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075358    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume\") pod \"c1d60736-e683-43d7-94b1-bae330fed23b\" (UID: \"c1d60736-e683-43d7-94b1-bae330fed23b\") "
Aug 04 16:10:12.075678 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075656    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vhtf\" (UniqueName: \"kubernetes.io/projected/21296202-7f8f-473e-be15-df5a9ded36eb-kube-api-access-2vhtf\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.075678 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075678    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21296202-7f8f-473e-be15-df5a9ded36eb-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.075839 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075675    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "774e58d2-7e31-43e6-852a-dacda4106285" (UID: "774e58d2-7e31-43e6-852a-dacda4106285"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:12.075839 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.075696    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1d60736-e683-43d7-94b1-bae330fed23b" (UID: "c1d60736-e683-43d7-94b1-bae330fed23b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:12.077023 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.076996    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl" (OuterVolumeSpecName: "kube-api-access-q24dl") pod "c1d60736-e683-43d7-94b1-bae330fed23b" (UID: "c1d60736-e683-43d7-94b1-bae330fed23b"). InnerVolumeSpecName "kube-api-access-q24dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:12.077111 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.077048    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9" (OuterVolumeSpecName: "kube-api-access-gqnl9") pod "774e58d2-7e31-43e6-852a-dacda4106285" (UID: "774e58d2-7e31-43e6-852a-dacda4106285"). InnerVolumeSpecName "kube-api-access-gqnl9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:12.176378 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.176350    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/774e58d2-7e31-43e6-852a-dacda4106285-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.176378 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.176376    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqnl9\" (UniqueName: \"kubernetes.io/projected/774e58d2-7e31-43e6-852a-dacda4106285-kube-api-access-gqnl9\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.176502 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.176389    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1d60736-e683-43d7-94b1-bae330fed23b-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.176502 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.176402    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q24dl\" (UniqueName: \"kubernetes.io/projected/c1d60736-e683-43d7-94b1-bae330fed23b-kube-api-access-q24dl\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:12.201844 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.201820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:12.794617 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.794590    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"
Aug 04 16:10:12.794987 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.794582    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb" event={"ID":"774e58d2-7e31-43e6-852a-dacda4106285","Type":"ContainerDied","Data":"751cbcaaf2dbefafb8b3ad9edc123ea34e297b379adbe1e9763d13ad8655d0ac"}
Aug 04 16:10:12.794987 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.794726    2571 scope.go:117] "RemoveContainer" containerID="21f5d2ca9d2f1b6614585000cf2fbd2abbdd153e947fbdee023d9de9d7363b9c"
Aug 04 16:10:12.796060 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.796041    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"
Aug 04 16:10:12.796144 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.796061    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv" event={"ID":"c1d60736-e683-43d7-94b1-bae330fed23b","Type":"ContainerDied","Data":"89974ca72f0a6acfe18a6d89163e20cd1fbe9a5a18a2d7b901eb9011c0419ad3"}
Aug 04 16:10:12.797702 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.797676    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn" event={"ID":"21296202-7f8f-473e-be15-df5a9ded36eb","Type":"ContainerDied","Data":"18d177ee1c65b80d9541fec2aabf614027a7f6bf759d1107cbdffe9e32b2d7af"}
Aug 04 16:10:12.797817 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.797717    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"
Aug 04 16:10:12.806028 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.806011    2571 scope.go:117] "RemoveContainer" containerID="6fa0a1b99d99e73d89aef22b692411fb7902925e98d98c8308cf79172c0395ea"
Aug 04 16:10:12.814504 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.814487    2571 scope.go:117] "RemoveContainer" containerID="108ea1fc239f39c0ecdbda70220fa9726389e43b06078bcc68e7f4927d2ffed6"
Aug 04 16:10:12.827399 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.827376    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 16:10:12.832180 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.832161    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-05b2bc-6b49bc467d-k6rfb"]
Aug 04 16:10:12.844061 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.844036    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 16:10:12.845814 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.845797    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-05b2bc-6bc8cc6dfc-f5fvn"]
Aug 04 16:10:12.858135 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.858115    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 16:10:12.864322 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:12.864302    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-05b2bc-98b85568d-hqxxv"]
Aug 04 16:10:13.724136 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:13.724107    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21296202-7f8f-473e-be15-df5a9ded36eb" path="/var/lib/kubelet/pods/21296202-7f8f-473e-be15-df5a9ded36eb/volumes"
Aug 04 16:10:13.724484 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:13.724470    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="774e58d2-7e31-43e6-852a-dacda4106285" path="/var/lib/kubelet/pods/774e58d2-7e31-43e6-852a-dacda4106285/volumes"
Aug 04 16:10:13.724792 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:13.724781    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d60736-e683-43d7-94b1-bae330fed23b" path="/var/lib/kubelet/pods/c1d60736-e683-43d7-94b1-bae330fed23b/volumes"
Aug 04 16:10:18.740728 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:18.740681    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:18.840396 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:18.840360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:19.030512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:19.030424    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:19.244069 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:19.244037    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:29.854439 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.854405    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 16:10:29.854837 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.854652    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" podUID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" containerName="maas-api" containerID="cri-o://f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4" gracePeriod=30
Aug 04 16:10:29.883825 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.883800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:29.913260 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.913207    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 16:10:29.913655 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.913483    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" podUID="cf829215-165c-4789-950f-2ecd3d2260ad" containerName="payload-processing" containerID="cri-o://c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e" gracePeriod=30
Aug 04 16:10:29.919635 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.919599    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 16:10:29.919814 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.919791    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" podUID="c417145c-212b-49bd-8030-c887fac5d5bf" containerName="payload-pre-processing" containerID="cri-o://bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a" gracePeriod=30
Aug 04 16:10:29.963868 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:29.963822    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:30.039729 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.039696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:30.139330 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.139128    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:30.198357 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.198337    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 16:10:30.202275 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.202256    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 16:10:30.214798 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.214777    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 16:10:30.240167 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240129    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls\") pod \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") "
Aug 04 16:10:30.240346 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240181    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume\") pod \"c417145c-212b-49bd-8030-c887fac5d5bf\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") "
Aug 04 16:10:30.240346 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240235    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k87sp\" (UniqueName: \"kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp\") pod \"c417145c-212b-49bd-8030-c887fac5d5bf\" (UID: \"c417145c-212b-49bd-8030-c887fac5d5bf\") "
Aug 04 16:10:30.240574 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240547    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c417145c-212b-49bd-8030-c887fac5d5bf" (UID: "c417145c-212b-49bd-8030-c887fac5d5bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:30.240667 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240609    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume\") pod \"cf829215-165c-4789-950f-2ecd3d2260ad\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") "
Aug 04 16:10:30.240667 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240656    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zv9qz\" (UniqueName: \"kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz\") pod \"cf829215-165c-4789-950f-2ecd3d2260ad\" (UID: \"cf829215-165c-4789-950f-2ecd3d2260ad\") "
Aug 04 16:10:30.240834 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240723    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca\") pod \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") "
Aug 04 16:10:30.240834 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.240810    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv52c\" (UniqueName: \"kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c\") pod \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\" (UID: \"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a\") "
Aug 04 16:10:30.241663 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.241178    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c417145c-212b-49bd-8030-c887fac5d5bf-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.242152 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.242098    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" (UID: "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:30.242319 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.242266    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cf829215-165c-4789-950f-2ecd3d2260ad" (UID: "cf829215-165c-4789-950f-2ecd3d2260ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 04 16:10:30.242737 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.242713    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp" (OuterVolumeSpecName: "kube-api-access-k87sp") pod "c417145c-212b-49bd-8030-c887fac5d5bf" (UID: "c417145c-212b-49bd-8030-c887fac5d5bf"). InnerVolumeSpecName "kube-api-access-k87sp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:30.242807 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.242735    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" (UID: "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 04 16:10:30.243607 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.243587    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c" (OuterVolumeSpecName: "kube-api-access-pv52c") pod "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" (UID: "21fa1ed2-9d05-4482-a6dc-8748c0d85b4a"). InnerVolumeSpecName "kube-api-access-pv52c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:30.243607 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.243596    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz" (OuterVolumeSpecName: "kube-api-access-zv9qz") pod "cf829215-165c-4789-950f-2ecd3d2260ad" (UID: "cf829215-165c-4789-950f-2ecd3d2260ad"). InnerVolumeSpecName "kube-api-access-zv9qz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 04 16:10:30.342209 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342187    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-openshift-service-ca\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.342209 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342208    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv52c\" (UniqueName: \"kubernetes.io/projected/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-kube-api-access-pv52c\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.342379 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342218    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a-maas-api-tls\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.342379 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342234    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k87sp\" (UniqueName: \"kubernetes.io/projected/c417145c-212b-49bd-8030-c887fac5d5bf-kube-api-access-k87sp\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.342379 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342245    2571 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cf829215-165c-4789-950f-2ecd3d2260ad-plugins-config-volume\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.342379 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.342259    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zv9qz\" (UniqueName: \"kubernetes.io/projected/cf829215-165c-4789-950f-2ecd3d2260ad-kube-api-access-zv9qz\") on node \"ip-10-0-136-138.ec2.internal\" DevicePath \"\""
Aug 04 16:10:30.455890 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.455851    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:30.901638 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.901610    2571 generic.go:356] "Generic (PLEG): container finished" podID="cf829215-165c-4789-950f-2ecd3d2260ad" containerID="c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e" exitCode=0
Aug 04 16:10:30.901977 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.901656    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"
Aug 04 16:10:30.901977 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.901690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" event={"ID":"cf829215-165c-4789-950f-2ecd3d2260ad","Type":"ContainerDied","Data":"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"}
Aug 04 16:10:30.901977 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.901749    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq" event={"ID":"cf829215-165c-4789-950f-2ecd3d2260ad","Type":"ContainerDied","Data":"398be42e3968cb68bcdf26c89be4c1711a57f0075e2c0865be69642b7abd3363"}
Aug 04 16:10:30.901977 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.901773    2571 scope.go:117] "RemoveContainer" containerID="c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"
Aug 04 16:10:30.903113 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.903086    2571 generic.go:356] "Generic (PLEG): container finished" podID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" containerID="f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4" exitCode=0
Aug 04 16:10:30.903238 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.903147    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"
Aug 04 16:10:30.903238 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.903175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" event={"ID":"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a","Type":"ContainerDied","Data":"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"}
Aug 04 16:10:30.903238 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.903221    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn" event={"ID":"21fa1ed2-9d05-4482-a6dc-8748c0d85b4a","Type":"ContainerDied","Data":"1e5cbe4fa992c59b05795b8480a17b18f480883c717832d3e34eb5fd882e959c"}
Aug 04 16:10:30.904562 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.904541    2571 generic.go:356] "Generic (PLEG): container finished" podID="c417145c-212b-49bd-8030-c887fac5d5bf" containerID="bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a" exitCode=0
Aug 04 16:10:30.904665 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.904572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" event={"ID":"c417145c-212b-49bd-8030-c887fac5d5bf","Type":"ContainerDied","Data":"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"}
Aug 04 16:10:30.904665 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.904586    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"
Aug 04 16:10:30.904665 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.904612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x" event={"ID":"c417145c-212b-49bd-8030-c887fac5d5bf","Type":"ContainerDied","Data":"64d02fb2f04b50259cdd5cc7c0e4b9f1a1e8892911db7261da492e48b370ff6e"}
Aug 04 16:10:30.911222 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.911202    2571 scope.go:117] "RemoveContainer" containerID="c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"
Aug 04 16:10:30.911532 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:10:30.911508    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e\": container with ID starting with c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e not found: ID does not exist" containerID="c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"
Aug 04 16:10:30.911608 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.911545    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e"} err="failed to get container status \"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e\": rpc error: code = NotFound desc = could not find container \"c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e\": container with ID starting with c807295c622901c115203e373256f499358d7553db7074d9b946d97de8c0392e not found: ID does not exist"
Aug 04 16:10:30.911608 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.911569    2571 scope.go:117] "RemoveContainer" containerID="f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"
Aug 04 16:10:30.920133 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.920118    2571 scope.go:117] "RemoveContainer" containerID="f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"
Aug 04 16:10:30.920391 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:10:30.920374    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4\": container with ID starting with f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4 not found: ID does not exist" containerID="f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"
Aug 04 16:10:30.920449 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.920398    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4"} err="failed to get container status \"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4\": rpc error: code = NotFound desc = could not find container \"f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4\": container with ID starting with f33456abba472f7e04a4e7b8c3b99f9eec01894842e7d4e50fd5956902f0e8d4 not found: ID does not exist"
Aug 04 16:10:30.920449 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.920413    2571 scope.go:117] "RemoveContainer" containerID="bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"
Aug 04 16:10:30.927384 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.927366    2571 scope.go:117] "RemoveContainer" containerID="bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"
Aug 04 16:10:30.927633 ip-10-0-136-138 kubenswrapper[2571]: E0804 16:10:30.927616    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a\": container with ID starting with bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a not found: ID does not exist" containerID="bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"
Aug 04 16:10:30.927676 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.927640    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a"} err="failed to get container status \"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a\": rpc error: code = NotFound desc = could not find container \"bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a\": container with ID starting with bb9e21a198ef4f4ff2bfd03f90e7f0d01dc0fc5580c5f3ffe0f78b663065536a not found: ID does not exist"
Aug 04 16:10:30.931222 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.931204    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 16:10:30.935243 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.935221    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-7b41f3-c49cdb558-2dvfq"]
Aug 04 16:10:30.946697 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.946664    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 16:10:30.953001 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.952982    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-7b41f3-698d5bfb48-dc99x"]
Aug 04 16:10:30.964277 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.964258    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 16:10:30.968300 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:30.968269    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-7b41f3-7b8b6745c5-567tn"]
Aug 04 16:10:31.724838 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:31.724806    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" path="/var/lib/kubelet/pods/21fa1ed2-9d05-4482-a6dc-8748c0d85b4a/volumes"
Aug 04 16:10:31.725252 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:31.725233    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c417145c-212b-49bd-8030-c887fac5d5bf" path="/var/lib/kubelet/pods/c417145c-212b-49bd-8030-c887fac5d5bf/volumes"
Aug 04 16:10:31.725651 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:31.725617    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf829215-165c-4789-950f-2ecd3d2260ad" path="/var/lib/kubelet/pods/cf829215-165c-4789-950f-2ecd3d2260ad/volumes"
Aug 04 16:10:36.861126 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:36.861089    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:36.953356 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:36.953319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:37.181762 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:37.181722    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:37.399713 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:37.399678    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:37.860169 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:37.860133    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c9d69cc-98bv8_14594c94-6b2b-48b5-93fd-72e90a7d703a/authorino/0.log"
Aug 04 16:10:43.747308 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:43.747265    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7c6d8bb5-84hrl_01fc436d-cc54-45b3-910c-66c0dbb6f826/manager/0.log"
Aug 04 16:10:44.109643 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:44.109568    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-drkkt_507dc8f5-0e73-47cd-b38a-ea4e11000cef/copy-manifests/0.log"
Aug 04 16:10:44.116801 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:44.116776    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-drkkt_507dc8f5-0e73-47cd-b38a-ea4e11000cef/manager/0.log"
Aug 04 16:10:44.784686 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:44.784644    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d6d98b4d7-r4mkc_6de68742-67d5-46b0-9de2-4f9a333f2870/maas-api/0.log"
Aug 04 16:10:44.899538 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:44.899513    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29764290-dt7hm_6d1b624c-719b-491e-a3e4-951d8109930e/cleanup/0.log"
Aug 04 16:10:45.266838 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:45.266807    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-z66cz_c30a466a-0be1-4027-8b1e-9cf67a56cdd6/postgres/0.log"
Aug 04 16:10:46.648018 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:46.647985    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c9d69cc-98bv8_14594c94-6b2b-48b5-93fd-72e90a7d703a/authorino/0.log"
Aug 04 16:10:48.234560 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:48.234518    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf99455-lglgv_512c6205-16ff-4899-9ad4-078282e7387a/kube-auth-proxy/0.log"
Aug 04 16:10:48.485440 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:48.485352    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m74gf_b294d1e7-bda0-46bd-a8d2-73adb00df0e1/payload-pre-processing/0.log"
Aug 04 16:10:48.616955 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:48.616926    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"
Aug 04 16:10:49.222553 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:49.222523    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-fct42_fd7ee1fc-ff76-4c0f-9c35-a90a006bcab6/main/0.log"
Aug 04 16:10:49.462853 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:49.462827    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgwzvc_64a7bc31-f4d6-4aba-b453-c2270eb39d97/main/0.log"
Aug 04 16:10:54.644811 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:54.644774    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:55.721519 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:55.721483    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:56.870401 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:56.870363    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log" limit=1024
Aug 04 16:10:58.693459 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:58.693425    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lchxp_81f9ac9c-2479-48e8-9cff-de214c7a0566/global-pull-secret-syncer/0.log"
Aug 04 16:10:58.860856 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:58.860823    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lqpsg_00f3297b-9f00-4ffc-9cc6-697505b9613a/konnectivity-agent/0.log"
Aug 04 16:10:59.000612 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:10:59.000521    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-138.ec2.internal_73bf5884360a6f56fb29aa28fa2e9510/haproxy/0.log"
Aug 04 16:11:03.812602 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:03.812562    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f6c9d69cc-98bv8_14594c94-6b2b-48b5-93fd-72e90a7d703a/authorino/0.log"
Aug 04 16:11:06.055907 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.055798    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/alertmanager/0.log"
Aug 04 16:11:06.087520 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.087487    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/config-reloader/0.log"
Aug 04 16:11:06.117702 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.117664    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/kube-rbac-proxy-web/0.log"
Aug 04 16:11:06.149942 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.149909    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/kube-rbac-proxy/0.log"
Aug 04 16:11:06.177224 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.177192    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/kube-rbac-proxy-metric/0.log"
Aug 04 16:11:06.207460 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.207431    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/prom-label-proxy/0.log"
Aug 04 16:11:06.240004 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.239973    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c2861b7-8316-445a-8309-11e1a43e8221/init-config-reloader/0.log"
Aug 04 16:11:06.334699 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.334600    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-mh4jq_c283f7ba-0e3d-4b43-a340-d0379db742df/kube-state-metrics/0.log"
Aug 04 16:11:06.359317 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.359272    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-mh4jq_c283f7ba-0e3d-4b43-a340-d0379db742df/kube-rbac-proxy-main/0.log"
Aug 04 16:11:06.385871 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.385835    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-6bd9664c4-mh4jq_c283f7ba-0e3d-4b43-a340-d0379db742df/kube-rbac-proxy-self/0.log"
Aug 04 16:11:06.420421 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.420385    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7cbb4d558c-kzmzp_e5a352ff-b031-4b99-bb43-ed576458b033/metrics-server/0.log"
Aug 04 16:11:06.454270 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.454224    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-6dffbbd67-2wmv7_27b8aac7-b51f-42d4-8448-45e040840f7c/monitoring-plugin/0.log"
Aug 04 16:11:06.610161 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.610131    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x22xk_e5826ad5-0c20-4154-a0cd-5954f57b7907/node-exporter/0.log"
Aug 04 16:11:06.652123 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.652095    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x22xk_e5826ad5-0c20-4154-a0cd-5954f57b7907/kube-rbac-proxy/0.log"
Aug 04 16:11:06.687068 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.687042    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-x22xk_e5826ad5-0c20-4154-a0cd-5954f57b7907/init-textfile/0.log"
Aug 04 16:11:06.826162 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.826133    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kzbfc_1d8c98d3-80aa-4580-b0b3-90be7d4fca96/kube-rbac-proxy-main/0.log"
Aug 04 16:11:06.856451 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.856421    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kzbfc_1d8c98d3-80aa-4580-b0b3-90be7d4fca96/kube-rbac-proxy-self/0.log"
Aug 04 16:11:06.886817 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.886758    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-kzbfc_1d8c98d3-80aa-4580-b0b3-90be7d4fca96/openshift-state-metrics/0.log"
Aug 04 16:11:06.936585 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.936554    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/prometheus/0.log"
Aug 04 16:11:06.974525 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:06.974492    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/config-reloader/0.log"
Aug 04 16:11:07.005703 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.005671    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/thanos-sidecar/0.log"
Aug 04 16:11:07.043717 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.043688    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/kube-rbac-proxy-web/0.log"
Aug 04 16:11:07.079420 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.079382    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/kube-rbac-proxy/0.log"
Aug 04 16:11:07.112805 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.112777    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/kube-rbac-proxy-thanos/0.log"
Aug 04 16:11:07.141966 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.141884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5302863f-cfa1-46bd-9698-b13ce0b5a63f/init-config-reloader/0.log"
Aug 04 16:11:07.180080 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.180048    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5tpm6_c438afc8-3ebd-4271-9559-a45d68b26cc7/prometheus-operator/0.log"
Aug 04 16:11:07.216641 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.216613    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-5tpm6_c438afc8-3ebd-4271-9559-a45d68b26cc7/kube-rbac-proxy/0.log"
Aug 04 16:11:07.297100 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.297064    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65fd8855b5-pwvnb_0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb/telemeter-client/0.log"
Aug 04 16:11:07.323744 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.323707    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65fd8855b5-pwvnb_0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb/reload/0.log"
Aug 04 16:11:07.352589 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.352560    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-65fd8855b5-pwvnb_0c5c49ae-88ea-43f8-8ecb-37cc6a2f6ebb/kube-rbac-proxy/0.log"
Aug 04 16:11:07.388850 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.388816    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/thanos-query/0.log"
Aug 04 16:11:07.415367 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.415278    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/kube-rbac-proxy-web/0.log"
Aug 04 16:11:07.445131 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.445102    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/kube-rbac-proxy/0.log"
Aug 04 16:11:07.474831 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.474799    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/prom-label-proxy/0.log"
Aug 04 16:11:07.503688 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.503659    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/kube-rbac-proxy-rules/0.log"
Aug 04 16:11:07.532637 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:07.532604    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fbdbc8b7-g854l_251c5559-fde4-408d-a22c-dad05e4fe2e9/kube-rbac-proxy-metrics/0.log"
Aug 04 16:11:08.635050 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635008    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"]
Aug 04 16:11:08.635663 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635641    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635667    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635679    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" containerName="maas-api"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635689    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" containerName="maas-api"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635709    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c417145c-212b-49bd-8030-c887fac5d5bf" containerName="payload-pre-processing"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635718    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c417145c-212b-49bd-8030-c887fac5d5bf" containerName="payload-pre-processing"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635729    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" containerName="maas-api"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635738    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" containerName="maas-api"
Aug 04 16:11:08.635753 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635751    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf829215-165c-4789-950f-2ecd3d2260ad" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635760    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf829215-165c-4789-950f-2ecd3d2260ad" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635775    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d60736-e683-43d7-94b1-bae330fed23b" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635784    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d60736-e683-43d7-94b1-bae330fed23b" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635797    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635806    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635824    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="774e58d2-7e31-43e6-852a-dacda4106285" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635834    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="774e58d2-7e31-43e6-852a-dacda4106285" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635856    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21296202-7f8f-473e-be15-df5a9ded36eb" containerName="maas-api"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635865    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="21296202-7f8f-473e-be15-df5a9ded36eb" containerName="maas-api"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635875    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635883    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.635984    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d60736-e683-43d7-94b1-bae330fed23b" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636000    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6ce13de-956c-4e6d-b0f9-b963754b8d9e" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636010    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3d1beb5-88c6-4bec-af6d-eef28bc0d4b2" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636020    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="21fa1ed2-9d05-4482-a6dc-8748c0d85b4a" containerName="maas-api"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636028    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="774e58d2-7e31-43e6-852a-dacda4106285" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636039    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf829215-165c-4789-950f-2ecd3d2260ad" containerName="payload-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636048    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="6055d5ff-b2dc-4d6b-acbe-20d6a305e5fa" containerName="maas-api"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636056    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="21296202-7f8f-473e-be15-df5a9ded36eb" containerName="maas-api"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636064    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c417145c-212b-49bd-8030-c887fac5d5bf" containerName="payload-pre-processing"
Aug 04 16:11:08.636141 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.636074    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="e30a94a8-38a8-4642-aa45-554b0b859075" containerName="payload-pre-processing"
Aug 04 16:11:08.639775 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.639754    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.642427 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.642401    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sz4ht\"/\"kube-root-ca.crt\""
Aug 04 16:11:08.643489 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.643472    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sz4ht\"/\"default-dockercfg-twtxh\""
Aug 04 16:11:08.643615 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.643597    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sz4ht\"/\"openshift-service-ca.crt\""
Aug 04 16:11:08.655931 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.655900    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"]
Aug 04 16:11:08.673320 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.673259    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grzsx\" (UniqueName: \"kubernetes.io/projected/b6fca764-9e6f-4c72-af24-bc1b37734efe-kube-api-access-grzsx\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.673645 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.673619    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-sys\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.673767 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.673699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-proc\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.673767 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.673740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-podres\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.673905 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.673872    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-lib-modules\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775275 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775227    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grzsx\" (UniqueName: \"kubernetes.io/projected/b6fca764-9e6f-4c72-af24-bc1b37734efe-kube-api-access-grzsx\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775340    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-sys\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775401    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-proc\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775429    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-podres\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775463    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-lib-modules\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775512 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775464    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-sys\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775732 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775549    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-proc\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775732 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775606    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-lib-modules\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.775732 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.775612    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b6fca764-9e6f-4c72-af24-bc1b37734efe-podres\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.787784 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.787755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grzsx\" (UniqueName: \"kubernetes.io/projected/b6fca764-9e6f-4c72-af24-bc1b37734efe-kube-api-access-grzsx\") pod \"perf-node-gather-daemonset-xxxfw\" (UID: \"b6fca764-9e6f-4c72-af24-bc1b37734efe\") " pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:08.958372 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:08.958202    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:09.104605 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:09.104582    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"]
Aug 04 16:11:09.107867 ip-10-0-136-138 kubenswrapper[2571]: W0804 16:11:09.107806    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb6fca764_9e6f_4c72_af24_bc1b37734efe.slice/crio-a07ffba44334cfa5ebd5c70b676f2d2683a515f6e24d7b381189c90ce444a76d WatchSource:0}: Error finding container a07ffba44334cfa5ebd5c70b676f2d2683a515f6e24d7b381189c90ce444a76d: Status 404 returned error can't find the container with id a07ffba44334cfa5ebd5c70b676f2d2683a515f6e24d7b381189c90ce444a76d
Aug 04 16:11:10.008070 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:10.008038    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5bf98869d5-kzjq5_bded8191-4a60-45bb-a780-4fceed852089/console/0.log"
Aug 04 16:11:10.117517 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:10.117479    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw" event={"ID":"b6fca764-9e6f-4c72-af24-bc1b37734efe","Type":"ContainerStarted","Data":"536a6b07255ef0369205f7eb10f7a577a3f2ddcf6e65a1dbe8fc8fba1eab3a0a"}
Aug 04 16:11:10.117710 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:10.117655    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:10.117710 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:10.117697    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw" event={"ID":"b6fca764-9e6f-4c72-af24-bc1b37734efe","Type":"ContainerStarted","Data":"a07ffba44334cfa5ebd5c70b676f2d2683a515f6e24d7b381189c90ce444a76d"}
Aug 04 16:11:10.136488 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:10.136427    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw" podStartSLOduration=2.136409471 podStartE2EDuration="2.136409471s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-04 16:11:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-04 16:11:10.13464389 +0000 UTC m=+3862.966612010" watchObservedRunningTime="2026-08-04 16:11:10.136409471 +0000 UTC m=+3862.968377588"
Aug 04 16:11:12.012482 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:12.012424    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jgmcm_5ab41724-da7b-42b7-a4c7-e97f11a7f21c/dns/0.log"
Aug 04 16:11:12.046598 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:12.046572    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jgmcm_5ab41724-da7b-42b7-a4c7-e97f11a7f21c/kube-rbac-proxy/0.log"
Aug 04 16:11:12.105422 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:12.105391    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjsfq_cec2985c-9403-49fd-ba66-f5f36e348cf7/dns-node-resolver/0.log"
Aug 04 16:11:12.892063 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:12.892035    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x5l8b_25f6e80e-d6ec-49df-a7fa-d9d5e638d09e/node-ca/0.log"
Aug 04 16:11:14.160633 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:14.160601    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf99455-lglgv_512c6205-16ff-4899-9ad4-078282e7387a/kube-auth-proxy/0.log"
Aug 04 16:11:14.273391 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:14.273363    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m74gf_b294d1e7-bda0-46bd-a8d2-73adb00df0e1/payload-pre-processing/0.log"
Aug 04 16:11:14.318120 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:14.318092    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"
Aug 04 16:11:15.243842 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:15.243805    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-km7n5_f5109330-6309-451b-8a12-cdbc10db479a/serve-healthcheck-canary/0.log"
Aug 04 16:11:16.038439 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:16.038374    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnzcd_9152172d-cfec-4b52-9150-e5914c7dbeed/kube-rbac-proxy/0.log"
Aug 04 16:11:16.064029 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:16.063996    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnzcd_9152172d-cfec-4b52-9150-e5914c7dbeed/exporter/0.log"
Aug 04 16:11:16.090009 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:16.089984    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wnzcd_9152172d-cfec-4b52-9150-e5914c7dbeed/extractor/0.log"
Aug 04 16:11:16.132477 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:16.132456    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sz4ht/perf-node-gather-daemonset-xxxfw"
Aug 04 16:11:19.136603 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.136570    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7f7c6d8bb5-84hrl_01fc436d-cc54-45b3-910c-66c0dbb6f826/manager/0.log"
Aug 04 16:11:19.336546 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.336513    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-drkkt_507dc8f5-0e73-47cd-b38a-ea4e11000cef/manager/0.log"
Aug 04 16:11:19.374543 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.374518    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-764fcd8dc-drkkt_507dc8f5-0e73-47cd-b38a-ea4e11000cef/copy-manifests/0.log"
Aug 04 16:11:19.588929 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.588834    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf99455-lglgv_512c6205-16ff-4899-9ad4-078282e7387a/kube-auth-proxy/0.log"
Aug 04 16:11:19.684604 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.684569    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m74gf_b294d1e7-bda0-46bd-a8d2-73adb00df0e1/payload-pre-processing/0.log"
Aug 04 16:11:19.717274 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:19.717248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"
Aug 04 16:11:20.948128 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:20.948097    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-598d546c6b-4rvt2_07b1d9a1-c990-4ce3-9f70-6f9afa039204/manager/0.log"
Aug 04 16:11:21.009387 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:21.009357    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-swlw9_f9af9ebf-29a1-4e80-a881-5b44ff2d3c38/openshift-lws-operator/0.log"
Aug 04 16:11:21.418623 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:21.418593    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c7cf99455-lglgv_512c6205-16ff-4899-9ad4-078282e7387a/kube-auth-proxy/0.log"
Aug 04 16:11:21.514213 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:21.514183    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-m74gf_b294d1e7-bda0-46bd-a8d2-73adb00df0e1/payload-pre-processing/0.log"
Aug 04 16:11:21.548459 ip-10-0-136-138 kubenswrapper[2571]: I0804 16:11:21.548422    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-xtrnn_a59105d2-952f-4e49-a80d-5ced3943b6c1/payload-processing/0.log"