Jul 27 18:28:53.749691 ip-10-0-134-47 systemd[1]: Starting Kubernetes Kubelet...
Jul 27 18:28:54.175517 ip-10-0-134-47 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:28:54.175517 ip-10-0-134-47 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 27 18:28:54.175517 ip-10-0-134-47 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:28:54.175517 ip-10-0-134-47 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 27 18:28:54.175517 ip-10-0-134-47 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 27 18:28:54.179092 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.178991    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 27 18:28:54.182697 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182684    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.182697 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182698    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182702    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182706    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182709    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182712    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182716    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182720    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182723    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182726    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182728    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182731    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182734    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182736    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182739    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182741    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182744    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182746    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182749    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.182762 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.182751    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.183287 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183278    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.183287 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183288    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183291    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183295    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183298    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183301    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183304    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183307    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183310    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183312    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183315    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183317    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183320    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183323    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183325    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183328    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183331    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183333    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183336    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183340    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183344    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.183343 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183347    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183350    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183353    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183356    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183358    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183361    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183364    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183366    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183369    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183371    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183374    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183376    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183380    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183383    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183386    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183389    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183391    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183394    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183397    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.183831 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183399    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183402    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183404    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183407    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183409    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183413    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183415    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183419    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183421    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183424    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183426    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183429    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183431    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183434    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183436    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183451    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183454    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183457    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183460    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183462    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.184286 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183471    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183474    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183477    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183479    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183482    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183485    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183487    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183489    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183492    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183494    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183497    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183499    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183502    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183504    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183507    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183509    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183512    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183515    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.184776 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.183517    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.185683 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185672    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.185683 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185683    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185687    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185690    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185693    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185696    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185700    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185703    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185706    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185709    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185712    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185715    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185717    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185720    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185723    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185726    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185728    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185731    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185733    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.185743 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185736    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185738    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185741    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185743    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185746    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185748    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185751    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185754    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185756    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185759    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185761    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185764    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185766    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185769    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185771    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185774    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185776    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185779    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185781    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185783    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.186178 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185786    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185788    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185791    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185793    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185796    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185798    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185801    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185803    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185806    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185809    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185811    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185814    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185817    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185820    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185825    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185828    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185830    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185833    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185836    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185838    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.186679 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185841    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185844    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185847    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185849    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185851    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185854    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185857    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185859    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185863    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185866    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185868    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185872    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185875    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185878    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185880    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185883    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185885    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185888    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185891    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185893    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.187176 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185896    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185899    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185903    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185906    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185909    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185911    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185914    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185917    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185921    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185923    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185926    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185929    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185932    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185934    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185937    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185940    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185943    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185946    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185948    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.185951    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.187659 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186299    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186303    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186306    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186309    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186311    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186314    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186316    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186319    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186324    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186327    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186330    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186334    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186336    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186340    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186342    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186344    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186347    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186349    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186354    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.188227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186357    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186361    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186363    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186366    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186369    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186372    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186374    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186377    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186379    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186382    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186384    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186387    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186389    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186392    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186394    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186397    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186399    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186402    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186404    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186406    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.188733 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186409    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186411    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186414    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186416    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186419    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186421    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186423    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186426    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186429    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186432    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186434    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186451    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186455    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186457    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186460    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186463    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186465    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186468    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186470    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186473    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.189227 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186475    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186478    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186480    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186484    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186487    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186489    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186492    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186494    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186497    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186499    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186501    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186504    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186506    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186509    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186511    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186514    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186516    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186518    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186521    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186523    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.189726 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186526    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186528    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186532    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186536    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186539    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186543    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186546    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186548    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186551    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186553    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186556    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186558    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186560    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186563    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186565    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186568    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186570    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186573    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186576    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.186578    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.190207 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186644    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186651    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186662    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186667    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186671    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186674    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186678    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186683    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186686    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186689    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186692    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186696    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186698    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186702    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186705    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186712    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186715    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186717    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186721    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186724    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186727    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186730    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186733    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186736    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 27 18:28:54.190727 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186739    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186742    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186745    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186748    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186751    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186753    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186757    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186759    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186763    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186766    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186769    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186771    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186774    2567 flags.go:64] FLAG: --enable-server="true"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186778    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186782    2567 flags.go:64] FLAG: --event-burst="100"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186785    2567 flags.go:64] FLAG: --event-qps="50"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186788    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186791    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186794    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186797    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186800    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186803    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186806    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186810    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186813    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 27 18:28:54.191305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186816    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186819    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186822    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186824    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186827    2567 flags.go:64] FLAG: --feature-gates=""
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186831    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186833    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186836    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186839    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186842    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186845    2567 flags.go:64] FLAG: --help="false"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186848    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186851    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186854    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186856    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186860    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186863    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186866    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186868    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186871    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186874    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186877    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186880    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186882    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 27 18:28:54.191963 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186885    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186888    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186891    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186894    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186896    2567 flags.go:64] FLAG: --lock-file=""
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186899    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186903    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186906    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186911    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186914    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186917    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186920    2567 flags.go:64] FLAG: --logging-format="text"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186922    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186926    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186928    2567 flags.go:64] FLAG: --manifest-url=""
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186931    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186935    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186938    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186942    2567 flags.go:64] FLAG: --max-pods="110"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186945    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186947    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186950    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186953    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186956    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186959    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 27 18:28:54.192559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186961    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186968    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186971    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186974    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186977    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186980    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186985    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186988    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186991    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186994    2567 flags.go:64] FLAG: --port="10250"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186996    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.186999    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-051a3a59a66e22b0e"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187002    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187005    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187010    2567 flags.go:64] FLAG: --register-node="true"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187013    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187016    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187019    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187022    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187024    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187028    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187031    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187034    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187036    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187039    2567 flags.go:64] FLAG: --runonce="false"
Jul 27 18:28:54.193233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187042    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187045    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187048    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187051    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187054    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187057    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187059    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187062    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187065    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187068    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187071    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187073    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187077    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187081    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187083    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187088    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187091    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187094    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187098    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187100    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187103    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187107    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187110    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187113    2567 flags.go:64] FLAG: --v="2"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187125    2567 flags.go:64] FLAG: --version="false"
Jul 27 18:28:54.193852 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187129    2567 flags.go:64] FLAG: --vmodule=""
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187133    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187136    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187239    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187243    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187246    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187249    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187252    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187254    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187257    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187259    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187262    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187264    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187266    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187269    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187286    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187290    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187294    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187297    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187304    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.194467 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187306    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187309    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187312    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187314    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187317    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187320    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187322    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187325    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187328    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187331    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187334    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187336    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187339    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187342    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187344    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187347    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187350    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187352    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187355    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187357    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.194958 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187360    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187362    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187365    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187368    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187370    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187373    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187375    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187377    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187380    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187382    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187385    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187389    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187391    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187394    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187396    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187399    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187402    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187404    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187407    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.195513 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187409    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187413    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187415    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187419    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187424    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187427    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187430    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187433    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187436    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187452    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187455    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187458    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187461    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187463    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187466    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187469    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187471    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187474    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187476    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.195974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187479    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187482    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187484    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187487    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187490    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187494    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187496    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187499    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187501    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187504    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187507    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187509    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187513    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187516    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187520    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187523    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187526    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187528    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187531    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187534    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.196453 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187536    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187539    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187541    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.187544    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.187548    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.194387    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.194401    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.195328    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.195337    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195401    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195405    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195409    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195412    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195415    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195418    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.196941 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195421    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195424    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195427    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195430    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195433    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195436    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195450    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195453    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195456    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195459    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195461    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195464    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195467    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195470    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195473    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195483    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195486    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195488    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195491    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195494    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.197307 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195496    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195499    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195502    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195505    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195507    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195511    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195515    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195518    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195521    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195524    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195527    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195530    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195532    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195535    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195537    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195540    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195543    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195547    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195550    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.197810 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195553    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195555    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195558    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195560    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195563    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195565    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195568    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195570    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195573    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195581    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195583    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195586    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195588    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195591    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195593    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195596    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195598    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195601    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195603    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195606    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.198270 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195609    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195611    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195613    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195616    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195618    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195620    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195623    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195625    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195627    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195630    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195632    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195635    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195637    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195639    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195642    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195644    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195646    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195649    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195651    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195654    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.198847 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195657    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195659    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195667    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195670    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195672    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195674    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195677    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195680    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195682    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195685    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195687    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195692    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195695    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195698    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.199342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.195704    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195840    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195844    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195847    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195850    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195852    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195855    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195857    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195860    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195862    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195865    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195867    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195870    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195872    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195874    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195877    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195880    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195884    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195887    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 27 18:28:54.199713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195889    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195892    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195900    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195903    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195905    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195908    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195910    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195913    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195915    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195918    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195920    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195922    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195925    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195927    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195930    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195932    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195935    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195937    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195939    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195942    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 27 18:28:54.200278 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195944    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195947    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195949    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195951    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195953    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195956    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195958    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195961    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195963    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195965    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195968    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195971    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195973    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195976    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195978    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195986    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195989    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195991    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195994    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195997    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 27 18:28:54.200875 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.195999    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196001    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196004    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196013    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196016    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196018    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196021    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196023    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196025    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196028    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196030    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196033    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196035    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196037    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196040    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196042    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196044    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196047    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196049    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 27 18:28:54.201713 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196051    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196055    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196058    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196061    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196064    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196067    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196069    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196072    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196074    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196083    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196085    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196091    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196093    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196096    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196099    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196102    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196105    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196108    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196111    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 27 18:28:54.202421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196114    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196116    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:54.196119    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.196123    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.196221    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.198394    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.199733    2567 server.go:1019] "Starting client certificate rotation"
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.199859    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.199901    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 27 18:28:54.202898 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.202204    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:28:54.204674 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.203676    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 27 18:28:54.217205 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.217189    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 27 18:28:54.219267 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.219254    2567 log.go:25] "Validated CRI v1 image API"
Jul 27 18:28:54.221136 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.221118    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 27 18:28:54.223370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.223349    2567 fs.go:135] Filesystem UUIDs: map[5693d0a4-2857-4f7d-b858-3058a2594e2c:/dev/nvme0n1p4 73f61368-5bee-42d9-8f62-b7c358ecae95:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 27 18:28:54.223465 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.223370    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 27 18:28:54.228467 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.228343    2567 manager.go:216] Machine: {Timestamp:2026-07-27 18:28:54.226954163 +0000 UTC m=+0.352808495 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3108400 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec21732b26c6de290909cbd7f3619f65 SystemUUID:ec21732b-26c6-de29-0909-cbd7f3619f65 BootID:859ba156-1255-4edb-9b44-71d9e4dcac5e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:da:b7:79:74:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:da:b7:79:74:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:de:78:18:05:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 27 18:28:54.228467 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.228455    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 27 18:28:54.228644 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.228549    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 27 18:28:54.228644 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.228630    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:28:54.231403 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.231377    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 27 18:28:54.231589 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.231407    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-47.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 27 18:28:54.232347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.232335    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 27 18:28:54.232408 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.232352    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 27 18:28:54.232408 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.232369    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:28:54.233123 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.233110    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 27 18:28:54.233953 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.233940    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 27 18:28:54.235812 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.235797    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:28:54.235967 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.235955    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 27 18:28:54.236037 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.235995    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 27 18:28:54.236037 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236008    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 27 18:28:54.236037 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236027    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 27 18:28:54.236159 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236040    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 27 18:28:54.236159 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236051    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 27 18:28:54.236464 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236429    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:28:54.236548 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.236536    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 27 18:28:54.238917 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.238900    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 27 18:28:54.240888 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.240863    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 27 18:28:54.240974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.240901    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 27 18:28:54.242569 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242555    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242576    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242585    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242593    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242605    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242613    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242624    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242632    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242643    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 27 18:28:54.242649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242650    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 27 18:28:54.242915 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242663    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 27 18:28:54.242915 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.242671    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 27 18:28:54.244007 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.243995    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 27 18:28:54.244060 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.244011    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 27 18:28:54.246934 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.246918    2567 server.go:1268] "Started kubelet"
Jul 27 18:28:54.247018 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.247001    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 27 18:28:54.247080 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.247012    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 27 18:28:54.247131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.247086    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 27 18:28:54.247656 ip-10-0-134-47 systemd[1]: Started Kubernetes Kubelet.
Jul 27 18:28:54.247815 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.247786    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 27 18:28:54.247893 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.247854    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-47.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 27 18:28:54.248184 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.248049    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-47.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 27 18:28:54.248892 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.248874    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 27 18:28:54.249525 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.249505    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 27 18:28:54.250703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.250677    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzkpg"
Jul 27 18:28:54.254887 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.254865    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 27 18:28:54.256109 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256096    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 27 18:28:54.256177 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256114    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 27 18:28:54.256231 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.256184    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.256886 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256713    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 27 18:28:54.256886 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256714    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 27 18:28:54.256886 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256744    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 27 18:28:54.257310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256891    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 27 18:28:54.257310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256900    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 27 18:28:54.257310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256901    2567 factory.go:55] Registering systemd factory
Jul 27 18:28:54.257310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.256942    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 27 18:28:54.257310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.257299    2567 factory.go:153] Registering CRI-O factory
Jul 27 18:28:54.257571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.257317    2567 factory.go:223] Registration of the crio container factory successfully
Jul 27 18:28:54.257571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.257369    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 27 18:28:54.257571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.257428    2567 factory.go:103] Registering Raw factory
Jul 27 18:28:54.257571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.257488    2567 manager.go:1196] Started watching for new ooms in manager
Jul 27 18:28:54.258244 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.258216    2567 manager.go:349] Starting recovery of all containers
Jul 27 18:28:54.258410 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.257347    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-47.ec2.internal.18c638f6a301c5b7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-47.ec2.internal,UID:ip-10-0-134-47.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-47.ec2.internal,},FirstTimestamp:2026-07-27 18:28:54.246892983 +0000 UTC m=+0.372747316,LastTimestamp:2026-07-27 18:28:54.246892983 +0000 UTC m=+0.372747316,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-47.ec2.internal,}"
Jul 27 18:28:54.258955 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.258935    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zzkpg"
Jul 27 18:28:54.263965 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.263928    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 27 18:28:54.267466 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.267428    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:54.268231 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.268213    2567 manager.go:354] Recovery completed
Jul 27 18:28:54.272365 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.272349    2567 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-47.ec2.internal\" not found" node="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.273130 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.273117    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.274730 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.274715    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.274782 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.274742    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.274782 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.274755    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.275251 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275239    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 27 18:28:54.275294 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275251    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 27 18:28:54.275294 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275266    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 27 18:28:54.275352 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275240    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.275933 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275918    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.275981 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275945    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.275981 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.275955    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.276854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.276783    2567 policy_none.go:49] "None policy: Start"
Jul 27 18:28:54.276854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.276799    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 27 18:28:54.276854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.276808    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 27 18:28:54.277802 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.277788    2567 policy_none.go:47] "Start"
Jul 27 18:28:54.321093 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.320953    2567 manager.go:337] "Starting Device Plugin manager"
Jul 27 18:28:54.321205 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.321116    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 27 18:28:54.321205 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321127    2567 server.go:87] "Starting device plugin registration server"
Jul 27 18:28:54.321330 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321319    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 27 18:28:54.321371 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321331    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 27 18:28:54.321480 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321465    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 27 18:28:54.321561 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321549    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 27 18:28:54.321561 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.321558    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 27 18:28:54.322011 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.321985    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 27 18:28:54.322083 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.322043    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.376039 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.376019    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 27 18:28:54.377978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.376056    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 27 18:28:54.377978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.376075    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 27 18:28:54.377978 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.376108    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 27 18:28:54.378520 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.378506    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:54.422317 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.422303    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.423030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.423012    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.423123 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.423041    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.423123 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.423051    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.423123 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.423071    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.429711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.429676    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.429711 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.429695    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-47.ec2.internal\": node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.447626 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.447609    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.476683 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.476663    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"]
Jul 27 18:28:54.476749 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.476727    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.477462 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.477434    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.477527 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.477473    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.477527 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.477488    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.479789 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.479776    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.479904 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.479889    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.479958 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.479923    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.480410 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480389    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.480518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480414    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.480518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480428    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.480518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480460    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.480518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480476    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.480518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.480487    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.482576 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.482558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.482665 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.482584    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 27 18:28:54.483194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.483181    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientMemory"
Jul 27 18:28:54.483271 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.483201    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasNoDiskPressure"
Jul 27 18:28:54.483271 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.483209    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeHasSufficientPID"
Jul 27 18:28:54.506990 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.506968    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-47.ec2.internal\" not found" node="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.511387 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.511372    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-47.ec2.internal\" not found" node="ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.548246 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.548228    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.558614 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.558593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.558680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.558620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.558680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.558643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a73749570711c6068d304e4f5dc5093-config\") pod \"kube-apiserver-proxy-ip-10-0-134-47.ec2.internal\" (UID: \"4a73749570711c6068d304e4f5dc5093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.648876 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.648852    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.659168 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.659221 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.659254 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659176    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.659287 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659256    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b5e6cf05109960ab140efd601d6fe269-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal\" (UID: \"b5e6cf05109960ab140efd601d6fe269\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.659287 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a73749570711c6068d304e4f5dc5093-config\") pod \"kube-apiserver-proxy-ip-10-0-134-47.ec2.internal\" (UID: \"4a73749570711c6068d304e4f5dc5093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.659348 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.659299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4a73749570711c6068d304e4f5dc5093-config\") pod \"kube-apiserver-proxy-ip-10-0-134-47.ec2.internal\" (UID: \"4a73749570711c6068d304e4f5dc5093\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.749613 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.749561    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.810086 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.810064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.814841 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:54.814832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:54.849779 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.849759    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:54.950177 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:54.950150    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.050637 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.050600    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.151182 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.151162    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.199619 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.199601    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 27 18:28:55.199939 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.199704    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 18:28:55.199939 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.199743    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 27 18:28:55.251622 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.251604    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.264512 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.264480    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-26 18:23:54 +0000 UTC" deadline="2028-03-26 00:47:36.444351614 +0000 UTC"
Jul 27 18:28:55.264512 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.264510    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14574h18m41.179844423s"
Jul 27 18:28:55.352585 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.352509    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.400224 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:55.400196    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a73749570711c6068d304e4f5dc5093.slice/crio-a1cb2d58b5576e5a12e1b91ba05fc60bf29bda1b20c17d42721da9cd334e5edb WatchSource:0}: Error finding container a1cb2d58b5576e5a12e1b91ba05fc60bf29bda1b20c17d42721da9cd334e5edb: Status 404 returned error can't find the container with id a1cb2d58b5576e5a12e1b91ba05fc60bf29bda1b20c17d42721da9cd334e5edb
Jul 27 18:28:55.400566 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:55.400546    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e6cf05109960ab140efd601d6fe269.slice/crio-cf0ff0bfaa9be8779b83be626b1d2c4504409ea47c4bae24c0b581b188040a36 WatchSource:0}: Error finding container cf0ff0bfaa9be8779b83be626b1d2c4504409ea47c4bae24c0b581b188040a36: Status 404 returned error can't find the container with id cf0ff0bfaa9be8779b83be626b1d2c4504409ea47c4bae24c0b581b188040a36
Jul 27 18:28:55.405288 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.405271    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:28:55.454113 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.454095    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.559611 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.559580    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.659785 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.659738    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.760719 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:55.760690    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-47.ec2.internal\" not found"
Jul 27 18:28:55.776244 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.776225    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:55.800234 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.800214    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:55.856244 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.856224    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:55.865104 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.865082    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:28:55.866325 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.866313    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal"
Jul 27 18:28:55.881752 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:55.881732    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 27 18:28:56.230330 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.230295    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:56.237717 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.237682    2567 apiserver.go:52] "Watching apiserver"
Jul 27 18:28:56.252625 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.252595    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 27 18:28:56.253506 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.253476    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-vz7tn","openshift-cluster-node-tuning-operator/tuned-vl8bz","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal","openshift-multus/multus-additional-cni-plugins-5clgb","openshift-multus/multus-ngll5","openshift-network-operator/iptables-alerter-rrkgz","openshift-ovn-kubernetes/ovnkube-node-m6p7f","kube-system/global-pull-secret-syncer-xfzx4","kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz","openshift-dns/node-resolver-phbsr","openshift-image-registry/node-ca-grbv2","openshift-multus/network-metrics-daemon-ht6s2","openshift-network-diagnostics/network-check-target-2wk79"]
Jul 27 18:28:56.257185 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.256852    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 27 18:28:56.257185 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.257031    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.259444 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.259419    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.259587 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.259517    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:28:56.260679 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.260650    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261720    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261755    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7gqrv\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261768    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261777    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261841    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261776    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 27 18:28:56.262040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.261996    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:56.262318 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.262051    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:28:56.264906 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.264476    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.267598 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.267550    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 27 18:28:56.267965 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.267941    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.268101 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.268082    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 27 18:28:56.268173 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.268125    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 27 18:28:56.268346 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.268328    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mcct4\""
Jul 27 18:28:56.268558 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.268538    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.268890 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.268873    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.269426 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269408    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-slash\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269520 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-netns\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269520 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-log-socket\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269520    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269544    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-netd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269569    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-config\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269601    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-env-overrides\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269626    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-systemd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-etc-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dlth\" (UniqueName: \"kubernetes.io/projected/9d462fed-2ca6-4ef5-be55-e3aff760877f-kube-api-access-6dlth\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269720    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/593730fd-24be-465e-8f73-b822268c39e7-kube-api-access-jnpmg\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269769    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovn-node-metrics-cert\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-script-lib\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269816    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.269865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269839    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-node-log\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269881    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-kubelet\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269908    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-systemd-units\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269945    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-var-lib-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.269968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-ovn\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.270008    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-bin\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.270226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.270034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.271171 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.271149    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 27 18:28:56.271303 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.271286    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 27 18:28:56.271444 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.271427    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vmnbn\""
Jul 27 18:28:56.271534 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.271517    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.273804 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.273658    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.273804 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.273741    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:28:56.274097 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.274075    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.274213 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.274197    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.274358 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.274339    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vsnt9\""
Jul 27 18:28:56.274538 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.274448    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 27 18:28:56.276618 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.276303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.279223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.278614    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 27 18:28:56.279223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.278830    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.279223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.278872    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 27 18:28:56.279223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.278891    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dxz2n\""
Jul 27 18:28:56.281428 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.281407    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-stdww\""
Jul 27 18:28:56.281544 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.281487    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.281544 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.281524    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.281667 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.281643    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.284038 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.284016    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.284145 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.284067    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 27 18:28:56.284300 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.284281    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.284375 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.284326    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.285568 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.285517    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cqfq8\""
Jul 27 18:28:56.286688 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.286669    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.286882 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.286861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cc5kb\""
Jul 27 18:28:56.289616 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.289586    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.289715 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.289602    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.289715 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.289646    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 27 18:28:56.289824 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.289730    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 27 18:28:56.290839 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.290815    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 27 18:28:56.290930 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.290880    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-msf2r\""
Jul 27 18:28:56.295581 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.295559    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pngbn"
Jul 27 18:28:56.307345 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.307220    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pngbn"
Jul 27 18:28:56.358545 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.358521    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 27 18:28:56.370576 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370192    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.370576 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370233    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-system-cni-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.370576 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.370308    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:56.370576 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.370379    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:28:56.870356826 +0000 UTC m=+2.996211164 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:56.370576 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370546    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cnibin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cni-binary-copy\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370617    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-multus-certs\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovn-node-metrics-cert\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-script-lib\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370696    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-serviceca\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370722    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-systemd-units\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370749    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-var-lib-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-config\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370799    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-netd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-env-overrides\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.370876 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370848    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj2qn\" (UniqueName: \"kubernetes.io/projected/43267a11-04a1-4513-a316-4affad972044-kube-api-access-sj2qn\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370885    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-system-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370913    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-os-release\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-dbus\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370982    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.370999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-hostroot\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371013    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-conf-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371008    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371030    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-daemon-config\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-modprobe-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371059    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-run\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371073    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-tmp\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371107    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371127    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-netns\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30fb11be-4e9f-4a9a-88eb-ae29044d65de-host-slash\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.371362 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371170    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2tb8\" (UniqueName: \"kubernetes.io/projected/7140841e-dc03-4418-b626-52810a3d3573-kube-api-access-m2tb8\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371184    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s65tv\" (UniqueName: \"kubernetes.io/projected/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kube-api-access-s65tv\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371225    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-kubelet\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371248    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkcrp\" (UniqueName: \"kubernetes.io/projected/30fb11be-4e9f-4a9a-88eb-ae29044d65de-kube-api-access-pkcrp\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371286    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-kubernetes\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371305    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-var-lib-kubelet\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371334    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/593730fd-24be-465e-8f73-b822268c39e7-kube-api-access-jnpmg\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4mp\" (UniqueName: \"kubernetes.io/projected/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-kube-api-access-5g4mp\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-bin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcggn\" (UniqueName: \"kubernetes.io/projected/4e9ae64d-8c31-416a-b03a-1337ac6187d4-kube-api-access-lcggn\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371446    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-systemd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-etc-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371487    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-host\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371525    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.372206 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-socket-dir-parent\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371557    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-multus\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59glm\" (UniqueName: \"kubernetes.io/projected/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-kube-api-access-59glm\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-systemd\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371602    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371624    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-conf\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371645    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-sys\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371670    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-lib-modules\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7140841e-dc03-4418-b626-52810a3d3573-hosts-file\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc0e49eb-80a1-4841-9918-28b397567670-agent-certs\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371735    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-node-log\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.371800    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-var-lib-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-netd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-script-lib\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372448    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-systemd-units\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372493    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovnkube-config\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372526    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-kubelet\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.372931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372523    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9d462fed-2ca6-4ef5-be55-e3aff760877f-env-overrides\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372607    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-systemd\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-ovn\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372853    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-etc-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372891    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-node-log\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-ovn\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372935    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysconfig\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7140841e-dc03-4418-b626-52810a3d3573-tmp-dir\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.372997    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e49eb-80a1-4841-9918-28b397567670-konnectivity-ca\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373031    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-device-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373092    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-log-socket\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-log-socket\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373187    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373192    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373215    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-cnibin\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.373709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-etc-kubernetes\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dlth\" (UniqueName: \"kubernetes.io/projected/9d462fed-2ca6-4ef5-be55-e3aff760877f-kube-api-access-6dlth\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373285    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-kubelet\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373371    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-host\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373520    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-run-openvswitch\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-bin\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373602    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373631    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-cni-bin\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-kubelet-config\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373690    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373728    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-slash\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-netns\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373800    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30fb11be-4e9f-4a9a-88eb-ae29044d65de-iptables-alerter-script\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373811    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-run-netns\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.374342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373835    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-tuned\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.375194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373850    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9d462fed-2ca6-4ef5-be55-e3aff760877f-host-slash\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.375194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-os-release\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.375194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373897    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-binary-copy\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.375194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.373932    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-k8s-cni-cncf-io\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.375194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.375009    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9d462fed-2ca6-4ef5-be55-e3aff760877f-ovn-node-metrics-cert\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.381152 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.381102    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal" event={"ID":"b5e6cf05109960ab140efd601d6fe269","Type":"ContainerStarted","Data":"cf0ff0bfaa9be8779b83be626b1d2c4504409ea47c4bae24c0b581b188040a36"}
Jul 27 18:28:56.381913 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.381892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dlth\" (UniqueName: \"kubernetes.io/projected/9d462fed-2ca6-4ef5-be55-e3aff760877f-kube-api-access-6dlth\") pod \"ovnkube-node-m6p7f\" (UID: \"9d462fed-2ca6-4ef5-be55-e3aff760877f\") " pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.382012 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.381894    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnpmg\" (UniqueName: \"kubernetes.io/projected/593730fd-24be-465e-8f73-b822268c39e7-kube-api-access-jnpmg\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.383131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.383103    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal" event={"ID":"4a73749570711c6068d304e4f5dc5093","Type":"ContainerStarted","Data":"a1cb2d58b5576e5a12e1b91ba05fc60bf29bda1b20c17d42721da9cd334e5edb"}
Jul 27 18:28:56.474457 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkcrp\" (UniqueName: \"kubernetes.io/projected/30fb11be-4e9f-4a9a-88eb-ae29044d65de-kube-api-access-pkcrp\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.474609 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474472    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-kubernetes\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474609 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-var-lib-kubelet\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474609 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474515    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.474609 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4mp\" (UniqueName: \"kubernetes.io/projected/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-kube-api-access-5g4mp\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.474609 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-bin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474610    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcggn\" (UniqueName: \"kubernetes.io/projected/4e9ae64d-8c31-416a-b03a-1337ac6187d4-kube-api-access-lcggn\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474615    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-var-lib-kubelet\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474636    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-host\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474588    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-kubernetes\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-bin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-socket-dir-parent\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474688    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-multus\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59glm\" (UniqueName: \"kubernetes.io/projected/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-kube-api-access-59glm\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-systemd\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-host\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474741    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-conf\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.474784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474768    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-cni-multus\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474822    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-sys\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474840    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-socket-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474873    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-socket-dir-parent\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474772    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-sys\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474910    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-lib-modules\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7140841e-dc03-4418-b626-52810a3d3573-hosts-file\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc0e49eb-80a1-4841-9918-28b397567670-agent-certs\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474972    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.474995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysconfig\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475019    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-systemd\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475020    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7140841e-dc03-4418-b626-52810a3d3573-tmp-dir\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475051    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e49eb-80a1-4841-9918-28b397567670-konnectivity-ca\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-device-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475110    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-cnibin\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.475175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475140    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-etc-kubernetes\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-kubelet\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475195    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475242    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-host\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475265    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-kubelet-config\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475021    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-conf\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475277    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7140841e-dc03-4418-b626-52810a3d3573-tmp-dir\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475290    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysconfig\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475322    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30fb11be-4e9f-4a9a-88eb-ae29044d65de-iptables-alerter-script\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475340    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-device-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.475799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-tuned\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475828    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-lib-modules\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475846    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-sysctl-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.475907    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-os-release\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-cnibin\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476179    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-var-lib-kubelet\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476248    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7140841e-dc03-4418-b626-52810a3d3573-hosts-file\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.476347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476302    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-registration-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.476718 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476646    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/30fb11be-4e9f-4a9a-88eb-ae29044d65de-iptables-alerter-script\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.476815 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.476908 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476888    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-kubelet-config\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.476978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476960    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-os-release\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.477030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.476970    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-binary-copy\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.477030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477013    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-host\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.477125 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477059    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-k8s-cni-cncf-io\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477125 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477102    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bc0e49eb-80a1-4841-9918-28b397567670-konnectivity-ca\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.477125 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477111    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-k8s-cni-cncf-io\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477286 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477184    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-etc-kubernetes\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477286 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-system-cni-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.477387 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477342    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43267a11-04a1-4513-a316-4affad972044-system-cni-dir\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.477387 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477346    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cnibin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477415    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cnibin\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cni-binary-copy\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477478    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-multus-certs\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477655 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477537    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-multus-certs\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477655 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-serviceca\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.477655 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477616    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj2qn\" (UniqueName: \"kubernetes.io/projected/43267a11-04a1-4513-a316-4affad972044-kube-api-access-sj2qn\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.477805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-system-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477696    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-os-release\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.477805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477729    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-dbus\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.477805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.477805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477789    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-hostroot\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477820    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-conf-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-daemon-config\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477878    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-modprobe-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477909    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-run\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477937    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-tmp\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477949    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-cni-binary-copy\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477967    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.477998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.478040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-netns\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.478048    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30fb11be-4e9f-4a9a-88eb-ae29044d65de-host-slash\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478127    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2tb8\" (UniqueName: \"kubernetes.io/projected/7140841e-dc03-4418-b626-52810a3d3573-kube-api-access-m2tb8\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.478143    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:28:56.978124712 +0000 UTC m=+3.103979038 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478215    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s65tv\" (UniqueName: \"kubernetes.io/projected/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kube-api-access-s65tv\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.478468 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478411    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-hostroot\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478914 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478489    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-conf-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478914 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478743    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-system-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.478914 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478812    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-os-release\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.479059 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478931    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/40a32a8f-1059-44c0-acaa-b8209ca2401a-dbus\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.479059 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.478974    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-daemon-config\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.479163 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479070    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-tuned\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.479163 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479139    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.479250 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479169    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-sys-fs\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.479301 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479250    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-multus-cni-dir\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.479301 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479259    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-etc-modprobe-d\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.479395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479299    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bc0e49eb-80a1-4841-9918-28b397567670-agent-certs\") pod \"konnectivity-agent-vz7tn\" (UID: \"bc0e49eb-80a1-4841-9918-28b397567670\") " pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.479395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479312    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-host-run-netns\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.479395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479348    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/30fb11be-4e9f-4a9a-88eb-ae29044d65de-host-slash\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.479395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479386    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4e9ae64d-8c31-416a-b03a-1337ac6187d4-run\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.479602 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479398    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-etc-selinux\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.479932 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.479911    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43267a11-04a1-4513-a316-4affad972044-cni-binary-copy\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.481611 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.481555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-serviceca\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.482169 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.482038    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e9ae64d-8c31-416a-b03a-1337ac6187d4-tmp\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.484102 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.484068    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4mp\" (UniqueName: \"kubernetes.io/projected/e0ebc520-7f9a-43d7-879f-7788ae8c71e1-kube-api-access-5g4mp\") pod \"node-ca-grbv2\" (UID: \"e0ebc520-7f9a-43d7-879f-7788ae8c71e1\") " pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.484176 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.484117    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59glm\" (UniqueName: \"kubernetes.io/projected/2f8e2366-5e9d-43cf-8b97-aea0fbe9480a-kube-api-access-59glm\") pod \"multus-ngll5\" (UID: \"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a\") " pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.485163 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.485140    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcggn\" (UniqueName: \"kubernetes.io/projected/4e9ae64d-8c31-416a-b03a-1337ac6187d4-kube-api-access-lcggn\") pod \"tuned-vl8bz\" (UID: \"4e9ae64d-8c31-416a-b03a-1337ac6187d4\") " pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.485730 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.485710    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkcrp\" (UniqueName: \"kubernetes.io/projected/30fb11be-4e9f-4a9a-88eb-ae29044d65de-kube-api-access-pkcrp\") pod \"iptables-alerter-rrkgz\" (UID: \"30fb11be-4e9f-4a9a-88eb-ae29044d65de\") " pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.487911 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.487892    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:28:56.487987 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.487914    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:28:56.487987 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.487927    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:56.488079 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.487993    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:28:56.987976901 +0000 UTC m=+3.113831236 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:56.492071 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.492048    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2tb8\" (UniqueName: \"kubernetes.io/projected/7140841e-dc03-4418-b626-52810a3d3573-kube-api-access-m2tb8\") pod \"node-resolver-phbsr\" (UID: \"7140841e-dc03-4418-b626-52810a3d3573\") " pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.492578 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.492550    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj2qn\" (UniqueName: \"kubernetes.io/projected/43267a11-04a1-4513-a316-4affad972044-kube-api-access-sj2qn\") pod \"multus-additional-cni-plugins-5clgb\" (UID: \"43267a11-04a1-4513-a316-4affad972044\") " pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.493208 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.493187    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s65tv\" (UniqueName: \"kubernetes.io/projected/521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9-kube-api-access-s65tv\") pod \"aws-ebs-csi-driver-node-t4dgz\" (UID: \"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.569688 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.569662    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:28:56.578756 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.578733    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5clgb"
Jul 27 18:28:56.589511 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.589491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ngll5"
Jul 27 18:28:56.598944 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.598928    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rrkgz"
Jul 27 18:28:56.608558 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.608520    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:28:56.616117 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.616099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vl8bz"
Jul 27 18:28:56.623601 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.623582    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz"
Jul 27 18:28:56.632119 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.632103    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-phbsr"
Jul 27 18:28:56.638636 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.638621    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-grbv2"
Jul 27 18:28:56.659771 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.659753    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 27 18:28:56.881323 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.881256    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:56.881498 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.881403    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:56.881498 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.881488    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:28:57.881469116 +0000 UTC m=+4.007323440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:56.982065 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:56.982036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:56.982198 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.982168    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:56.982257 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:56.982216    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:28:57.982203886 +0000 UTC m=+4.108058206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:57.083016 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:57.082991    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:57.083156 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.083117    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:28:57.083156 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.083133    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:28:57.083156 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.083141    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:57.083249 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.083187    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:28:58.083174271 +0000 UTC m=+4.209028590 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:57.311277 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:57.311202    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:23:56 +0000 UTC" deadline="2028-01-10 13:24:39.141871063 +0000 UTC"
Jul 27 18:28:57.311277 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:57.311231    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12762h55m41.830644543s"
Jul 27 18:28:57.427658 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.427633    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30fb11be_4e9f_4a9a_88eb_ae29044d65de.slice/crio-d0e0cda924aee9d7850913a7a53e87115499ddd1577b67ab12096ce83e1c1589 WatchSource:0}: Error finding container d0e0cda924aee9d7850913a7a53e87115499ddd1577b67ab12096ce83e1c1589: Status 404 returned error can't find the container with id d0e0cda924aee9d7850913a7a53e87115499ddd1577b67ab12096ce83e1c1589
Jul 27 18:28:57.428061 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.428042    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d462fed_2ca6_4ef5_be55_e3aff760877f.slice/crio-f550c9fb3c592fba4b037d277902ec519f98a1801f28cd9dc1f719f774590a8a WatchSource:0}: Error finding container f550c9fb3c592fba4b037d277902ec519f98a1801f28cd9dc1f719f774590a8a: Status 404 returned error can't find the container with id f550c9fb3c592fba4b037d277902ec519f98a1801f28cd9dc1f719f774590a8a
Jul 27 18:28:57.438785 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.438760    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod521e6fc1_3e0c_4f6c_9bf3_50257a05ecf9.slice/crio-b8d7cee2bba41f0c5defa63d42af2e994f3a4af97ff473d3c3999c538bcfcac7 WatchSource:0}: Error finding container b8d7cee2bba41f0c5defa63d42af2e994f3a4af97ff473d3c3999c538bcfcac7: Status 404 returned error can't find the container with id b8d7cee2bba41f0c5defa63d42af2e994f3a4af97ff473d3c3999c538bcfcac7
Jul 27 18:28:57.439815 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.439794    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8e2366_5e9d_43cf_8b97_aea0fbe9480a.slice/crio-4cade7e71fd53d1d204da7a4525574f2e10d4deaed022c7c9e537bec5cdd526a WatchSource:0}: Error finding container 4cade7e71fd53d1d204da7a4525574f2e10d4deaed022c7c9e537bec5cdd526a: Status 404 returned error can't find the container with id 4cade7e71fd53d1d204da7a4525574f2e10d4deaed022c7c9e537bec5cdd526a
Jul 27 18:28:57.440215 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.440195    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ebc520_7f9a_43d7_879f_7788ae8c71e1.slice/crio-fdd7a91eab8bcb036fbd506085e3fc9a06e3c36329cc5b0d536026b556d682c1 WatchSource:0}: Error finding container fdd7a91eab8bcb036fbd506085e3fc9a06e3c36329cc5b0d536026b556d682c1: Status 404 returned error can't find the container with id fdd7a91eab8bcb036fbd506085e3fc9a06e3c36329cc5b0d536026b556d682c1
Jul 27 18:28:57.441667 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.441573    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e9ae64d_8c31_416a_b03a_1337ac6187d4.slice/crio-466ca58569d8bfdb5c9625384b0c7b854be3170a31cb521ff4c0d4dbcb2da6cc WatchSource:0}: Error finding container 466ca58569d8bfdb5c9625384b0c7b854be3170a31cb521ff4c0d4dbcb2da6cc: Status 404 returned error can't find the container with id 466ca58569d8bfdb5c9625384b0c7b854be3170a31cb521ff4c0d4dbcb2da6cc
Jul 27 18:28:57.442974 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:28:57.442955    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43267a11_04a1_4513_a316_4affad972044.slice/crio-992fc166c7e38f312c6760378b14057239f5adc81741e26ffcf5102d8d426667 WatchSource:0}: Error finding container 992fc166c7e38f312c6760378b14057239f5adc81741e26ffcf5102d8d426667: Status 404 returned error can't find the container with id 992fc166c7e38f312c6760378b14057239f5adc81741e26ffcf5102d8d426667
Jul 27 18:28:57.887874 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:57.887488    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:57.887874 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.887653    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:57.887874 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.887873    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:28:59.887849693 +0000 UTC m=+6.013704027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:57.988621 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:57.988584    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:57.988774 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.988753    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:57.988845 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:57.988814    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:28:59.988795001 +0000 UTC m=+6.114649327 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:28:58.089725 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.089690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:58.089876 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.089860    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:28:58.089943 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.089879    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:28:58.089943 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.089893    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:58.090044 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.089947    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:00.089929402 +0000 UTC m=+6.215783745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:28:58.312279 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.312169    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-26 18:23:56 +0000 UTC" deadline="2028-02-02 05:31:19.654219962 +0000 UTC"
Jul 27 18:28:58.312279 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.312202    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13307h2m21.342022563s"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.378572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.378710    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.379093    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.379196    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.379259    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:28:58.379405 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:58.379338    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:28:58.396252 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.396215    2567 generic.go:356] "Generic (PLEG): container finished" podID="b5e6cf05109960ab140efd601d6fe269" containerID="38b77d42813c753bc9d6041b9846a4e13853629663c6ead0b2a4c4cc18e1e4a6" exitCode=0
Jul 27 18:28:58.396570 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.396509    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal" event={"ID":"b5e6cf05109960ab140efd601d6fe269","Type":"ContainerDied","Data":"38b77d42813c753bc9d6041b9846a4e13853629663c6ead0b2a4c4cc18e1e4a6"}
Jul 27 18:28:58.402338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.402307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-phbsr" event={"ID":"7140841e-dc03-4418-b626-52810a3d3573","Type":"ContainerStarted","Data":"5d812a9e07fa40ce5889aeb390b7074b0cab67d9c5e67204ed9cd14a77426ebe"}
Jul 27 18:28:58.404068 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.404044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ngll5" event={"ID":"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a","Type":"ContainerStarted","Data":"4cade7e71fd53d1d204da7a4525574f2e10d4deaed022c7c9e537bec5cdd526a"}
Jul 27 18:28:58.406934 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.406912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz" event={"ID":"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9","Type":"ContainerStarted","Data":"b8d7cee2bba41f0c5defa63d42af2e994f3a4af97ff473d3c3999c538bcfcac7"}
Jul 27 18:28:58.412947 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.412921    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrkgz" event={"ID":"30fb11be-4e9f-4a9a-88eb-ae29044d65de","Type":"ContainerStarted","Data":"d0e0cda924aee9d7850913a7a53e87115499ddd1577b67ab12096ce83e1c1589"}
Jul 27 18:28:58.418691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.418667    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal" event={"ID":"4a73749570711c6068d304e4f5dc5093","Type":"ContainerStarted","Data":"04b6688a89c64f5f80eb536bf98e0cd1d9a7e0dae7d28f42feb99a626b8f9988"}
Jul 27 18:28:58.429969 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.429945    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vz7tn" event={"ID":"bc0e49eb-80a1-4841-9918-28b397567670","Type":"ContainerStarted","Data":"5d7a0827c0bd69a7c1df7571845ca9c4c48dcdba324ebb044b74158442240c7b"}
Jul 27 18:28:58.437010 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.436183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerStarted","Data":"992fc166c7e38f312c6760378b14057239f5adc81741e26ffcf5102d8d426667"}
Jul 27 18:28:58.438482 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.438038    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl8bz" event={"ID":"4e9ae64d-8c31-416a-b03a-1337ac6187d4","Type":"ContainerStarted","Data":"466ca58569d8bfdb5c9625384b0c7b854be3170a31cb521ff4c0d4dbcb2da6cc"}
Jul 27 18:28:58.441650 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.441620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-grbv2" event={"ID":"e0ebc520-7f9a-43d7-879f-7788ae8c71e1","Type":"ContainerStarted","Data":"fdd7a91eab8bcb036fbd506085e3fc9a06e3c36329cc5b0d536026b556d682c1"}
Jul 27 18:28:58.448175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:58.448152    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"f550c9fb3c592fba4b037d277902ec519f98a1801f28cd9dc1f719f774590a8a"}
Jul 27 18:28:59.464041 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:59.463986    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal" event={"ID":"b5e6cf05109960ab140efd601d6fe269","Type":"ContainerStarted","Data":"a2c20625810f52c6a7dd8f01da20fe92c2368931d4eb79e6d498e9cc38642416"}
Jul 27 18:28:59.487262 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:59.487210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-47.ec2.internal" podStartSLOduration=4.487181822 podStartE2EDuration="4.487181822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:28:58.436067356 +0000 UTC m=+4.561921700" watchObservedRunningTime="2026-07-27 18:28:59.487181822 +0000 UTC m=+5.613036165"
Jul 27 18:28:59.903749 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:28:59.903666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:28:59.903896 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:59.903845    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:28:59.903949 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:28:59.903905    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:03.903885744 +0000 UTC m=+10.029740069 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:00.004915 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:00.004883    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:00.005121 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.005048    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:00.005194 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.005169    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:04.005150791 +0000 UTC m=+10.131005129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:00.105920 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:00.105743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:00.105920 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.105892    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:29:00.105920 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.105917    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:29:00.105920 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.105930    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:00.106239 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.105991    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:04.105972653 +0000 UTC m=+10.231827161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:00.382691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:00.382620    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:00.382855 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.382733    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:00.383125 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:00.383100    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:00.383232 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.383194    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:00.383297 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:00.383255    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:00.383358 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:00.383338    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:02.377613 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:02.377581    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:02.377613 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:02.377600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:02.378065 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:02.377580    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:02.378065 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:02.377719    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:02.378065 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:02.377781    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:02.378065 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:02.377853    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:03.938584 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:03.938545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:03.939000 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:03.938707    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:03.939000 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:03.938778    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:11.938759285 +0000 UTC m=+18.064613605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:04.039504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:04.039470    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:04.039654 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.039595    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:04.039705 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.039669    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:12.039649092 +0000 UTC m=+18.165503434 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:04.140514 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:04.140412    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:04.140938 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.140811    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:29:04.140938 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.140838    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:29:04.140938 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.140850    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:04.141193 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.141152    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:12.140893976 +0000 UTC m=+18.266748302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:04.378229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.378341    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:04.378714    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.378814    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:04.378870    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:04.379006 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:04.378930    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:06.376639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:06.376677    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:06.376643    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:06.376767    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:06.376877    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:06.377061 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:06.376953    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:08.377264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:08.377229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:08.377722 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:08.377229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:08.377722 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:08.377333    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:08.377722 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:08.377347    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:08.377722 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:08.377492    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:08.377722 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:08.377569    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:10.376645 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:10.376618    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:10.377147 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:10.376618    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:10.377147 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:10.376738    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:10.377147 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:10.376896    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:10.377147 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:10.376887    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:10.377147 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:10.376986    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:11.999956 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:11.999912    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:12.000413 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.000040    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:12.000413 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.000097    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:28.000077488 +0000 UTC m=+34.125931823 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:12.101237 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:12.101196    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:12.101397 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.101323    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:12.101480 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.101400    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:28.101376089 +0000 UTC m=+34.227230415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:12.202010 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:12.201977    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:12.202165 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.202115    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:29:12.202165 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.202133    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:29:12.202165 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.202144    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:12.202361 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.202242    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:28.202222804 +0000 UTC m=+34.328077141 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:12.377518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:12.377205    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:12.377518 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.377324    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:12.377518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:12.377210    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:12.377518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:12.377346    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:12.377518 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.377421    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:12.377888 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:12.377541    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:14.377787 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:14.377751    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:14.378223 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:14.377852    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:14.378223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:14.377967    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:14.378223 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:14.378099    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:14.378223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:14.378140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:14.378404 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:14.378256    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:16.377231 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:16.377203    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:16.377792 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:16.377252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:16.377792 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:16.377299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:16.377792 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:16.377397    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:16.377792 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:16.377477    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:16.377792 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:16.377511    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:17.503867 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.503510    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-vz7tn" event={"ID":"bc0e49eb-80a1-4841-9918-28b397567670","Type":"ContainerStarted","Data":"55c7d26a5ed1466be11aa95a6ea79d249249114a5f14637b9dac5fbc3e817b60"}
Jul 27 18:29:17.504952 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.504922    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="6465a0f05600763fed4b6abc68bae3a8624a36eecadf406b4d6cd8dc8625a322" exitCode=0
Jul 27 18:29:17.505039 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.505009    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"6465a0f05600763fed4b6abc68bae3a8624a36eecadf406b4d6cd8dc8625a322"}
Jul 27 18:29:17.506539 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.506507    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vl8bz" event={"ID":"4e9ae64d-8c31-416a-b03a-1337ac6187d4","Type":"ContainerStarted","Data":"844496165b7f9a365a2f9d2634816de1bc772d29ddbdfdad2565ade696eba7aa"}
Jul 27 18:29:17.508003 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.507981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-grbv2" event={"ID":"e0ebc520-7f9a-43d7-879f-7788ae8c71e1","Type":"ContainerStarted","Data":"7aa71ed0782e5c95b3cf7802c20606a2d5dd1e4db18a9ba0f7d94e66ec772e9d"}
Jul 27 18:29:17.510784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510763    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"c53d5fc6deec86f1a4f03e7f23f847cf58730753e3b6402e52d639e5c45901df"}
Jul 27 18:29:17.510865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510832    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"b9c9764a0d850e715259c989ecb204e1ba57379e4c5dbac648ebead9246f1204"}
Jul 27 18:29:17.510910 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510875    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"7292231870d5c0a4597b1f8edc923963e988e363bb586b8cab34057d63f6ddd2"}
Jul 27 18:29:17.510952 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510912    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"8494484623c77b6e84109d779d7b0a73d6ef946c7a2187a22b9d49327c0f80b9"}
Jul 27 18:29:17.510952 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510941    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"ea2377206064837c2760d6a38a8203e09181e71306d418d3ad99670977e0240d"}
Jul 27 18:29:17.511029 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.510972    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"3c125978d7c6ee959f93cf025ce357b51c7bb29e9c225c16c70e97cb16fcba0b"}
Jul 27 18:29:17.512068 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.512046    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-phbsr" event={"ID":"7140841e-dc03-4418-b626-52810a3d3573","Type":"ContainerStarted","Data":"1b3e298710f12077f5edfc2e89bdd3c44a9ffaa8089dc1952a51bb1e34e9382d"}
Jul 27 18:29:17.513521 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.513499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ngll5" event={"ID":"2f8e2366-5e9d-43cf-8b97-aea0fbe9480a","Type":"ContainerStarted","Data":"5c0e11fcb876eec0a92932729e7c8e717d2b83eef8a64d954c819b9bafd945fe"}
Jul 27 18:29:17.514675 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.514658    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz" event={"ID":"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9","Type":"ContainerStarted","Data":"64c616adc256fd3a8294f4ca613067039b9381d4bd40e3b2c0789dda78c22898"}
Jul 27 18:29:17.519968 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.519937    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-vz7tn" podStartSLOduration=8.532841641 podStartE2EDuration="23.51992637s" totalImagesPullingTime="14.987084729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:17.519860037 +0000 UTC m=+23.645714392" watchObservedRunningTime="2026-07-27 18:29:17.51992637 +0000 UTC m=+23.645780711"
Jul 27 18:29:17.520067 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.520051    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-47.ec2.internal" podStartSLOduration=22.520047601999998 podStartE2EDuration="22.520047602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:28:59.487788333 +0000 UTC m=+5.613642676" watchObservedRunningTime="2026-07-27 18:29:17.520047602 +0000 UTC m=+23.645901944"
Jul 27 18:29:17.535430 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.535394    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-grbv2" podStartSLOduration=4.578000215 podStartE2EDuration="23.535385502s" totalImagesPullingTime="18.957385287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:17.53494971 +0000 UTC m=+23.660804063" watchObservedRunningTime="2026-07-27 18:29:17.535385502 +0000 UTC m=+23.661239878"
Jul 27 18:29:17.580823 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.580787    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ngll5" podStartSLOduration=4.566325965 podStartE2EDuration="23.580772375s" totalImagesPullingTime="19.01444641s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:17.580731578 +0000 UTC m=+23.706585920" watchObservedRunningTime="2026-07-27 18:29:17.580772375 +0000 UTC m=+23.706626720"
Jul 27 18:29:17.615549 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:17.615514    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-phbsr" podStartSLOduration=4.656788354 podStartE2EDuration="23.615503212s" totalImagesPullingTime="18.958714858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:17.596544728 +0000 UTC m=+23.722399071" watchObservedRunningTime="2026-07-27 18:29:17.615503212 +0000 UTC m=+23.741357553"
Jul 27 18:29:18.377318 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.377288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:18.377639 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.377299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:18.377639 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.377299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:18.377639 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:18.377499    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:18.377639 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:18.377518    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:18.377639 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:18.377573    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:18.517594 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.517551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rrkgz" event={"ID":"30fb11be-4e9f-4a9a-88eb-ae29044d65de","Type":"ContainerStarted","Data":"fc602b013be91a56733efe2f3f461569d1fbf6ff8be296c189265bd9f8e57eae"}
Jul 27 18:29:18.538364 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.538325    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rrkgz" podStartSLOduration=5.569077302 podStartE2EDuration="24.538314973s" totalImagesPullingTime="18.969237671s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:18.538311367 +0000 UTC m=+24.664165708" watchObservedRunningTime="2026-07-27 18:29:18.538314973 +0000 UTC m=+24.664169314"
Jul 27 18:29:18.538798 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.538774    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vl8bz" podStartSLOduration=5.560338367 podStartE2EDuration="24.538766838s" totalImagesPullingTime="18.978428471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:17.615121835 +0000 UTC m=+23.740976177" watchObservedRunningTime="2026-07-27 18:29:18.538766838 +0000 UTC m=+24.664621183"
Jul 27 18:29:18.760286 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:18.760263    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 27 18:29:19.341021 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.340255    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-27T18:29:18.760283604Z","UUID":"a070899a-7330-4300-9efe-00755d463e64","Handler":null,"Name":"","Endpoint":""}
Jul 27 18:29:19.342077 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.342046    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 27 18:29:19.342202 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.342102    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 27 18:29:19.409939 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.409917    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:29:19.410507 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.410484    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:29:19.523968 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.523932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"e2b40cb2851ae5b4e82dcd51a8ce0b0caac0fbf30c4a547c786cc0ecf080ca47"}
Jul 27 18:29:19.526160 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.526136    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz" event={"ID":"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9","Type":"ContainerStarted","Data":"f34b1dea085c028baf576a08ee7c8b1eb8f10a977b397f9af239ce1db5d65026"}
Jul 27 18:29:19.526900 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.526884    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:29:19.527360 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:19.527340    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-vz7tn"
Jul 27 18:29:20.377233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:20.377204    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:20.377529 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:20.377204    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:20.377529 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:20.377313    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:20.377529 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:20.377393    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:20.377529 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:20.377204    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:20.377529 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:20.377493    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:20.530581 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:20.530547    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz" event={"ID":"521e6fc1-3e0c-4f6c-9bf3-50257a05ecf9","Type":"ContainerStarted","Data":"9070f2869c6bcaf5373c0ed97f58abb502fed4cb14ec0e75dd7127ef281e3b83"}
Jul 27 18:29:20.549829 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:20.549780    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-t4dgz" podStartSLOduration=4.434705239 podStartE2EDuration="26.549767337s" totalImagesPullingTime="22.115062098s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:20.549504488 +0000 UTC m=+26.675358831" watchObservedRunningTime="2026-07-27 18:29:20.549767337 +0000 UTC m=+26.675621678"
Jul 27 18:29:22.377256 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:22.377063    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:22.377708 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:22.377067    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:22.377708 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:22.377335    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:22.377708 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:22.377088    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:22.377708 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:22.377471    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:22.377708 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:22.377577    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:23.539388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.539356    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="962f2dce271c9314a1b728a8979123ade1888c2fb4fdf852d1bd74f23da25bf7" exitCode=0
Jul 27 18:29:23.540194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.539483    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"962f2dce271c9314a1b728a8979123ade1888c2fb4fdf852d1bd74f23da25bf7"}
Jul 27 18:29:23.544657 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.544635    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" event={"ID":"9d462fed-2ca6-4ef5-be55-e3aff760877f","Type":"ContainerStarted","Data":"72ee80570d5e223f6dc61cb67c8eb263858816e435f50172a6a27e6bdfcc3bbc"}
Jul 27 18:29:23.544916 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.544899    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:23.545022 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.544960    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:23.559994 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.559978    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:23.594537 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:23.594498    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f" podStartSLOduration=10.558111037 podStartE2EDuration="29.594487003s" totalImagesPullingTime="19.036375966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:23.593881599 +0000 UTC m=+29.719735941" watchObservedRunningTime="2026-07-27 18:29:23.594487003 +0000 UTC m=+29.720341344"
Jul 27 18:29:24.377653 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:24.377496    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:24.377899 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:24.377495    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:24.377899 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:24.377757    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:24.377899 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:24.377529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:24.377899 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:24.377810    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:24.378139 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:24.377899    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:24.547508 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:24.547482    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:24.563536 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:24.563516    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:25.031270 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.031246    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ht6s2"]
Jul 27 18:29:25.031421 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.031357    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:25.031524 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:25.031501    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:25.035213 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.035187    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfzx4"]
Jul 27 18:29:25.035321 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.035274    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:25.035399 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:25.035380    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:25.036751 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.036725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wk79"]
Jul 27 18:29:25.036848 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.036832    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:25.036967 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:25.036947    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:25.550517 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.550488    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="4f69c58f81d4254e1bac4ae3fa934d2729ee83d8edb0b929b77dc5cc986cba1c" exitCode=0
Jul 27 18:29:25.550890 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:25.550593    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"4f69c58f81d4254e1bac4ae3fa934d2729ee83d8edb0b929b77dc5cc986cba1c"}
Jul 27 18:29:26.376561 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:26.376491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:26.376697 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:26.376491    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:26.376697 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:26.376600    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:26.376697 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:26.376604    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:26.376697 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:26.376663    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:26.376843 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:26.376730    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:27.556326 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:27.556295    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="2bb7384228963611a63b71eda431bddfe9a1c19e810ccb9f588420bf408987b9" exitCode=0
Jul 27 18:29:27.556671 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:27.556346    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"2bb7384228963611a63b71eda431bddfe9a1c19e810ccb9f588420bf408987b9"}
Jul 27 18:29:28.026296 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.026113    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:28.026481 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.026264    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:28.026481 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.026408    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs podName:593730fd-24be-465e-8f73-b822268c39e7 nodeName:}" failed. No retries permitted until 2026-07-27 18:30:00.026393137 +0000 UTC m=+66.152247462 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs") pod "network-metrics-daemon-ht6s2" (UID: "593730fd-24be-465e-8f73-b822268c39e7") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 27 18:29:28.127494 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.127454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:28.127657 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.127589    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:28.127657 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.127656    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret podName:40a32a8f-1059-44c0-acaa-b8209ca2401a nodeName:}" failed. No retries permitted until 2026-07-27 18:30:00.127638755 +0000 UTC m=+66.253493075 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret") pod "global-pull-secret-syncer-xfzx4" (UID: "40a32a8f-1059-44c0-acaa-b8209ca2401a") : object "kube-system"/"original-pull-secret" not registered
Jul 27 18:29:28.227984 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.227958    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:28.228129 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.228109    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 27 18:29:28.228129 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.228128    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 27 18:29:28.228251 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.228137    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9zxhb for pod openshift-network-diagnostics/network-check-target-2wk79: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:28.228251 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.228185    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb podName:55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a nodeName:}" failed. No retries permitted until 2026-07-27 18:30:00.228171727 +0000 UTC m=+66.354026052 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9zxhb" (UniqueName: "kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb") pod "network-check-target-2wk79" (UID: "55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.377109    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.377126    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:28.377132    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.377232    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xfzx4" podUID="40a32a8f-1059-44c0-acaa-b8209ca2401a"
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.377314    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ht6s2" podUID="593730fd-24be-465e-8f73-b822268c39e7"
Jul 27 18:29:28.377563 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:28.377405    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2wk79" podUID="55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a"
Jul 27 18:29:30.209974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.209943    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-47.ec2.internal" event="NodeReady"
Jul 27 18:29:30.210371 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.210094    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 27 18:29:30.247400 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.247378    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:29:30.250198 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.250173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.252930 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.252909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 27 18:29:30.253087 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.252912    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 27 18:29:30.253087 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.252951    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-fwznz\""
Jul 27 18:29:30.253087 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.252959    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 27 18:29:30.258801 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.258679    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 27 18:29:30.261169 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.261148    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-frdg6"]
Jul 27 18:29:30.263244 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.263217    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:29:30.263347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.263256    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.265638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.265620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 27 18:29:30.265759 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.265728    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 27 18:29:30.267043 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.267027    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9pm47\""
Jul 27 18:29:30.271778 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.271757    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bg92n"]
Jul 27 18:29:30.273705 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.273689    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.276475 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.276425    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 27 18:29:30.281140 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.277008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 27 18:29:30.281140 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.277333    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frdg6"]
Jul 27 18:29:30.281140 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.277484    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xfn8t\""
Jul 27 18:29:30.281140 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.277697    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 27 18:29:30.286303 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.286280    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg92n"]
Jul 27 18:29:30.340711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340686    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mxtx\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.340833 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.340833 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340786    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.340833 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340823    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.340986 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.340986 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340965    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.341081 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.340993    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.341081 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.341029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.377103 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.377078    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:29:30.377103 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.377089    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:29:30.377458 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.377420    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:29:30.380715 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.380696    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:29:30.381069 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.381047    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:29:30.381891 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.381876    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:29:30.381967 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.381950    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fn8tb\""
Jul 27 18:29:30.382657 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.382639    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:29:30.382744 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.382659    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwbqc\""
Jul 27 18:29:30.442160 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-cert\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.442264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442183    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.442264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442213    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mxtx\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442238    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bef2d2a-5272-47a3-9d57-c245174f4cb7-config-volume\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.442414 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442414 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442414 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442374    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.442465    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.442483    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7d8968d7-k2sq8: secret "image-registry-tls" not found
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442489    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwfk4\" (UniqueName: \"kubernetes.io/projected/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-kube-api-access-gwfk4\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.442537    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls podName:7edd4e95-7522-41a2-af44-b5dd1734489a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:30.942516894 +0000 UTC m=+37.068371224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls") pod "image-registry-6b7d8968d7-k2sq8" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a") : secret "image-registry-tls" not found
Jul 27 18:29:30.442593 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d2a-5272-47a3-9d57-c245174f4cb7-tmp-dir\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.442938 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442607    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.442938 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442634    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58kbk\" (UniqueName: \"kubernetes.io/projected/1bef2d2a-5272-47a3-9d57-c245174f4cb7-kube-api-access-58kbk\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.442938 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.442782    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.443090 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.443005    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.443181 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.443162    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.443275 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.443258    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.446992 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.446971    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.447779 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.447762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.465273 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.465223    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mxtx\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.465388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.465367    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.543975 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.543948    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwfk4\" (UniqueName: \"kubernetes.io/projected/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-kube-api-access-gwfk4\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.544082 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.543989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d2a-5272-47a3-9d57-c245174f4cb7-tmp-dir\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.544169 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58kbk\" (UniqueName: \"kubernetes.io/projected/1bef2d2a-5272-47a3-9d57-c245174f4cb7-kube-api-access-58kbk\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.544229 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-cert\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.544286 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.544333 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bef2d2a-5272-47a3-9d57-c245174f4cb7-config-volume\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.544333 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1bef2d2a-5272-47a3-9d57-c245174f4cb7-tmp-dir\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.544427 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.544397    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:29:30.544506 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.544491    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls podName:1bef2d2a-5272-47a3-9d57-c245174f4cb7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:31.04447101 +0000 UTC m=+37.170325338 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls") pod "dns-default-frdg6" (UID: "1bef2d2a-5272-47a3-9d57-c245174f4cb7") : secret "dns-default-metrics-tls" not found
Jul 27 18:29:30.544784 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.544764    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1bef2d2a-5272-47a3-9d57-c245174f4cb7-config-volume\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.546746 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.546728    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-cert\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.553428 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.553407    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58kbk\" (UniqueName: \"kubernetes.io/projected/1bef2d2a-5272-47a3-9d57-c245174f4cb7-kube-api-access-58kbk\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:30.554142 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.554124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwfk4\" (UniqueName: \"kubernetes.io/projected/280b7998-ab95-44ab-87c6-fb4c6e0d4bd7-kube-api-access-gwfk4\") pod \"ingress-canary-bg92n\" (UID: \"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7\") " pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.588637 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.588612    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bg92n"
Jul 27 18:29:30.948128 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:30.948102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:30.948294 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.948242    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:29:30.948294 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.948255    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7d8968d7-k2sq8: secret "image-registry-tls" not found
Jul 27 18:29:30.948397 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:30.948312    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls podName:7edd4e95-7522-41a2-af44-b5dd1734489a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:31.948292203 +0000 UTC m=+38.074146526 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls") pod "image-registry-6b7d8968d7-k2sq8" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a") : secret "image-registry-tls" not found
Jul 27 18:29:31.048697 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.048669    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:31.048862 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.048837    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:29:31.048917 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.048906    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls podName:1bef2d2a-5272-47a3-9d57-c245174f4cb7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:32.048891025 +0000 UTC m=+38.174745347 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls") pod "dns-default-frdg6" (UID: "1bef2d2a-5272-47a3-9d57-c245174f4cb7") : secret "dns-default-metrics-tls" not found
Jul 27 18:29:31.523184 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.523028    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bg92n"]
Jul 27 18:29:31.525936 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:31.525909    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280b7998_ab95_44ab_87c6_fb4c6e0d4bd7.slice/crio-18985fe33f6456f399e32c9b095de99bef19d462833c15687489468055beef46 WatchSource:0}: Error finding container 18985fe33f6456f399e32c9b095de99bef19d462833c15687489468055beef46: Status 404 returned error can't find the container with id 18985fe33f6456f399e32c9b095de99bef19d462833c15687489468055beef46
Jul 27 18:29:31.568415 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.568378    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerStarted","Data":"27aaed4643f6e0b7dc43d392476c35bb3986922f45405f3fac3f6a941c26ac88"}
Jul 27 18:29:31.569653 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.569620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg92n" event={"ID":"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7","Type":"ContainerStarted","Data":"18985fe33f6456f399e32c9b095de99bef19d462833c15687489468055beef46"}
Jul 27 18:29:31.639313 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.639242    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8j"]
Jul 27 18:29:31.641408 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.641394    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.643935 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.643915    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 27 18:29:31.644338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.644326    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-584h7\""
Jul 27 18:29:31.644821 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.644802    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 27 18:29:31.644932 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.644816    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 27 18:29:31.644932 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.644802    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 27 18:29:31.655453 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.655419    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8j"]
Jul 27 18:29:31.754628 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.754609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a5210ea-1cf6-4807-b9df-bc386b4c2960-crio-socket\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.754712 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.754633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.754712 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.754669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.754792 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.754724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7dl9\" (UniqueName: \"kubernetes.io/projected/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-api-access-z7dl9\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.754792 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.754783    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a5210ea-1cf6-4807-b9df-bc386b4c2960-data-volume\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.856076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.856164    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7dl9\" (UniqueName: \"kubernetes.io/projected/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-api-access-z7dl9\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.856245    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a5210ea-1cf6-4807-b9df-bc386b4c2960-data-volume\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.856311    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a5210ea-1cf6-4807-b9df-bc386b4c2960-crio-socket\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.856345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.856498    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.856574    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:32.356550234 +0000 UTC m=+38.482404573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : configmap "kube-rbac-proxy" not found
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.856875    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.856929    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:32.356912228 +0000 UTC m=+38.482766563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.857429    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a5210ea-1cf6-4807-b9df-bc386b4c2960-data-volume\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.858592 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.857672    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a5210ea-1cf6-4807-b9df-bc386b4c2960-crio-socket\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.866261 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.866234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7dl9\" (UniqueName: \"kubernetes.io/projected/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-api-access-z7dl9\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:31.957613 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:31.957588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:31.957709 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.957693    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:29:31.957709 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.957704    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7d8968d7-k2sq8: secret "image-registry-tls" not found
Jul 27 18:29:31.957778 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:31.957751    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls podName:7edd4e95-7522-41a2-af44-b5dd1734489a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:33.957739268 +0000 UTC m=+40.083593589 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls") pod "image-registry-6b7d8968d7-k2sq8" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a") : secret "image-registry-tls" not found
Jul 27 18:29:32.058550 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.058522    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:32.058679 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.058662    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:29:32.058728 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.058718    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls podName:1bef2d2a-5272-47a3-9d57-c245174f4cb7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:34.058700774 +0000 UTC m=+40.184555105 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls") pod "dns-default-frdg6" (UID: "1bef2d2a-5272-47a3-9d57-c245174f4cb7") : secret "dns-default-metrics-tls" not found
Jul 27 18:29:32.361615 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.361545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:32.361764 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.361646    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:32.361764 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.361694    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:32.361764 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.361710    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 18:29:32.361764 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.361761    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:33.361744513 +0000 UTC m=+39.487598857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:32.361929 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:32.361776    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:33.36176961 +0000 UTC m=+39.487623931 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : configmap "kube-rbac-proxy" not found
Jul 27 18:29:32.467586 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.467556    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"]
Jul 27 18:29:32.469507 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.469482    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"
Jul 27 18:29:32.472322 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.472112    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 27 18:29:32.472322 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.472122    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-q7k94\""
Jul 27 18:29:32.472657 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.472639    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 27 18:29:32.479743 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.479721    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"]
Jul 27 18:29:32.563709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.563681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d6rm\" (UniqueName: \"kubernetes.io/projected/cab75b9c-c710-41a5-9bbf-a72b0a91d6fa-kube-api-access-8d6rm\") pod \"migrator-6865c9967-m59jv\" (UID: \"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"
Jul 27 18:29:32.576141 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.576111    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="27aaed4643f6e0b7dc43d392476c35bb3986922f45405f3fac3f6a941c26ac88" exitCode=0
Jul 27 18:29:32.576457 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.576177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"27aaed4643f6e0b7dc43d392476c35bb3986922f45405f3fac3f6a941c26ac88"}
Jul 27 18:29:32.664245 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.664221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d6rm\" (UniqueName: \"kubernetes.io/projected/cab75b9c-c710-41a5-9bbf-a72b0a91d6fa-kube-api-access-8d6rm\") pod \"migrator-6865c9967-m59jv\" (UID: \"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"
Jul 27 18:29:32.674022 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.674000    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d6rm\" (UniqueName: \"kubernetes.io/projected/cab75b9c-c710-41a5-9bbf-a72b0a91d6fa-kube-api-access-8d6rm\") pod \"migrator-6865c9967-m59jv\" (UID: \"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"
Jul 27 18:29:32.780593 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.780566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"
Jul 27 18:29:32.912191 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:32.912115    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv"]
Jul 27 18:29:32.916214 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:32.916185    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcab75b9c_c710_41a5_9bbf_a72b0a91d6fa.slice/crio-165a7de6ed4b798a0dde8b2d261fe1850ce4bb40c069c394d5f237411efc77e1 WatchSource:0}: Error finding container 165a7de6ed4b798a0dde8b2d261fe1850ce4bb40c069c394d5f237411efc77e1: Status 404 returned error can't find the container with id 165a7de6ed4b798a0dde8b2d261fe1850ce4bb40c069c394d5f237411efc77e1
Jul 27 18:29:33.218578 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.218556    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-phbsr_7140841e-dc03-4418-b626-52810a3d3573/dns-node-resolver/0.log"
Jul 27 18:29:33.371787 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.371754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:33.371935 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.371872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:33.371935 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.371917    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:33.372081 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.371968    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 18:29:33.372081 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.371976    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:35.371961299 +0000 UTC m=+41.497815623 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:33.372081 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.372009    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:35.371998081 +0000 UTC m=+41.497852400 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : configmap "kube-rbac-proxy" not found
Jul 27 18:29:33.580228 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.580151    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv" event={"ID":"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa","Type":"ContainerStarted","Data":"165a7de6ed4b798a0dde8b2d261fe1850ce4bb40c069c394d5f237411efc77e1"}
Jul 27 18:29:33.583700 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.583671    2567 generic.go:356] "Generic (PLEG): container finished" podID="43267a11-04a1-4513-a316-4affad972044" containerID="94ac8013bb7bcbc1f1b4f6f5bb3ee7c1fae3b7a5ab700e67d2e89e16ba8ee9b2" exitCode=0
Jul 27 18:29:33.583830 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.583714    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerDied","Data":"94ac8013bb7bcbc1f1b4f6f5bb3ee7c1fae3b7a5ab700e67d2e89e16ba8ee9b2"}
Jul 27 18:29:33.696957 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.696755    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-jxlsq"]
Jul 27 18:29:33.706427 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.706400    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.707530 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.707507    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-jxlsq"]
Jul 27 18:29:33.709379 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.708951    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 27 18:29:33.709379 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.709279    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 27 18:29:33.709517 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.709380    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-tdn79\""
Jul 27 18:29:33.709517 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.709428    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 27 18:29:33.709653 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.709638    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 27 18:29:33.876767 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.876702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-cabundle\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.876767 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.876733    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nt5\" (UniqueName: \"kubernetes.io/projected/a1b13b37-01ee-498c-8e36-1718323f1d82-kube-api-access-w9nt5\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.876767 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.876753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-key\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.977553 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.977529    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:33.977642 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.977625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-cabundle\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.977678 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.977645    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nt5\" (UniqueName: \"kubernetes.io/projected/a1b13b37-01ee-498c-8e36-1718323f1d82-kube-api-access-w9nt5\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.977678 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.977663    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-key\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.977678 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.977668    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:29:33.977824 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.977684    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7d8968d7-k2sq8: secret "image-registry-tls" not found
Jul 27 18:29:33.977824 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:33.977731    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls podName:7edd4e95-7522-41a2-af44-b5dd1734489a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:37.977715615 +0000 UTC m=+44.103569935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls") pod "image-registry-6b7d8968d7-k2sq8" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a") : secret "image-registry-tls" not found
Jul 27 18:29:33.978273 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.978252    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-cabundle\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.980644 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.980629    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a1b13b37-01ee-498c-8e36-1718323f1d82-signing-key\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:33.986669 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:33.986627    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nt5\" (UniqueName: \"kubernetes.io/projected/a1b13b37-01ee-498c-8e36-1718323f1d82-kube-api-access-w9nt5\") pod \"service-ca-658d7b7c78-jxlsq\" (UID: \"a1b13b37-01ee-498c-8e36-1718323f1d82\") " pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:34.017123 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.017099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq"
Jul 27 18:29:34.080513 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.079973    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:34.080513 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:34.080202    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:29:34.080513 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:34.080266    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls podName:1bef2d2a-5272-47a3-9d57-c245174f4cb7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:38.080247643 +0000 UTC m=+44.206101981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls") pod "dns-default-frdg6" (UID: "1bef2d2a-5272-47a3-9d57-c245174f4cb7") : secret "dns-default-metrics-tls" not found
Jul 27 18:29:34.158044 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.158013    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-jxlsq"]
Jul 27 18:29:34.160917 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:34.160893    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1b13b37_01ee_498c_8e36_1718323f1d82.slice/crio-a438e9b97d77b0f161fb9a1d887752d344cc2984396c16ec9f4641eaa9018aa0 WatchSource:0}: Error finding container a438e9b97d77b0f161fb9a1d887752d344cc2984396c16ec9f4641eaa9018aa0: Status 404 returned error can't find the container with id a438e9b97d77b0f161fb9a1d887752d344cc2984396c16ec9f4641eaa9018aa0
Jul 27 18:29:34.418734 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.418661    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-grbv2_e0ebc520-7f9a-43d7-879f-7788ae8c71e1/node-ca/0.log"
Jul 27 18:29:34.588352 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.588283    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bg92n" event={"ID":"280b7998-ab95-44ab-87c6-fb4c6e0d4bd7","Type":"ContainerStarted","Data":"830966bef5ab608020798149558fe17ba8ff59de9a69eb40300d9be87f713eae"}
Jul 27 18:29:34.589633 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.589605    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq" event={"ID":"a1b13b37-01ee-498c-8e36-1718323f1d82","Type":"ContainerStarted","Data":"a438e9b97d77b0f161fb9a1d887752d344cc2984396c16ec9f4641eaa9018aa0"}
Jul 27 18:29:34.593267 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.593249    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5clgb" event={"ID":"43267a11-04a1-4513-a316-4affad972044","Type":"ContainerStarted","Data":"fe8116f3356f26f06d3c0e68eafdef3179dac2c608a70ed7092ede0321b8f3ce"}
Jul 27 18:29:34.608649 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.608609    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bg92n" podStartSLOduration=2.0414191329999998 podStartE2EDuration="4.608594897s" totalImagesPullingTime="2.567175764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:34.607796114 +0000 UTC m=+40.733650455" watchObservedRunningTime="2026-07-27 18:29:34.608594897 +0000 UTC m=+40.734449268"
Jul 27 18:29:34.635270 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:34.635231    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5clgb" podStartSLOduration=10.300433921 podStartE2EDuration="40.635218172s" totalImagesPullingTime="30.334784251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:34.633812802 +0000 UTC m=+40.759667144" watchObservedRunningTime="2026-07-27 18:29:34.635218172 +0000 UTC m=+40.761072511"
Jul 27 18:29:35.020217 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:35.020182    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bg92n_280b7998-ab95-44ab-87c6-fb4c6e0d4bd7/serve-healthcheck-canary/0.log"
Jul 27 18:29:35.390654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:35.390587    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:35.390654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:35.390632    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:35.390851 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:35.390713    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 27 18:29:35.390851 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:35.390735    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:35.390851 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:35.390765    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:39.390751711 +0000 UTC m=+45.516606035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : configmap "kube-rbac-proxy" not found
Jul 27 18:29:35.390851 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:35.390784    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:39.390777455 +0000 UTC m=+45.516631774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:35.597095 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:35.597070    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv" event={"ID":"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa","Type":"ContainerStarted","Data":"0da3436e4969189125cf3c6bd20188911d552b903ef441502ae768b46cef0649"}
Jul 27 18:29:36.601625 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:36.601583    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv" event={"ID":"cab75b9c-c710-41a5-9bbf-a72b0a91d6fa","Type":"ContainerStarted","Data":"e98915e0c83d65bae4e2a26bd6d5b0ae45f8d96ba87b31dc633d0c455b58011b"}
Jul 27 18:29:36.625610 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:36.625559    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-m59jv" podStartSLOduration=2.075650637 podStartE2EDuration="4.625543615s" totalImagesPullingTime="2.549892978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:36.624715014 +0000 UTC m=+42.750569358" watchObservedRunningTime="2026-07-27 18:29:36.625543615 +0000 UTC m=+42.751397956"
Jul 27 18:29:37.605875 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:37.605829    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq" event={"ID":"a1b13b37-01ee-498c-8e36-1718323f1d82","Type":"ContainerStarted","Data":"a708ffb323f84f9e9bf872e69f7fe1e0fcc4179880502760a79c43073f39cf67"}
Jul 27 18:29:37.624827 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:37.624788    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-jxlsq" podStartSLOduration=1.410016992 podStartE2EDuration="4.62477441s" totalImagesPullingTime="3.214757418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:37.623077764 +0000 UTC m=+43.748932106" watchObservedRunningTime="2026-07-27 18:29:37.62477441 +0000 UTC m=+43.750628752"
Jul 27 18:29:38.010504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:38.010474    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:38.010649 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:38.010631    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 27 18:29:38.010721 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:38.010652    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b7d8968d7-k2sq8: secret "image-registry-tls" not found
Jul 27 18:29:38.010767 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:38.010719    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls podName:7edd4e95-7522-41a2-af44-b5dd1734489a nodeName:}" failed. No retries permitted until 2026-07-27 18:29:46.010698361 +0000 UTC m=+52.136552695 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls") pod "image-registry-6b7d8968d7-k2sq8" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a") : secret "image-registry-tls" not found
Jul 27 18:29:38.111159 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:38.111132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:38.111329 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:38.111276    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 27 18:29:38.111393 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:38.111335    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls podName:1bef2d2a-5272-47a3-9d57-c245174f4cb7 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:46.111318774 +0000 UTC m=+52.237173100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls") pod "dns-default-frdg6" (UID: "1bef2d2a-5272-47a3-9d57-c245174f4cb7") : secret "dns-default-metrics-tls" not found
Jul 27 18:29:39.421027 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:39.420990    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:39.421507 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:39.421065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:39.421507 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:39.421214    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:39.421507 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:29:39.421269    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls podName:9a5210ea-1cf6-4807-b9df-bc386b4c2960 nodeName:}" failed. No retries permitted until 2026-07-27 18:29:47.421251504 +0000 UTC m=+53.547105831 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zwb8j" (UID: "9a5210ea-1cf6-4807-b9df-bc386b4c2960") : secret "insights-runtime-extractor-tls" not found
Jul 27 18:29:39.422159 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:39.422137    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a5210ea-1cf6-4807-b9df-bc386b4c2960-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:46.072654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.072624    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:46.075006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.074988    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"image-registry-6b7d8968d7-k2sq8\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") " pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:46.162082 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.162055    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:46.173275 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.173252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:46.175357 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.175336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1bef2d2a-5272-47a3-9d57-c245174f4cb7-metrics-tls\") pod \"dns-default-frdg6\" (UID: \"1bef2d2a-5272-47a3-9d57-c245174f4cb7\") " pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:46.301603 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.301573    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:29:46.304492 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:46.304469    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7edd4e95_7522_41a2_af44_b5dd1734489a.slice/crio-9554f62486f2385c001a4b509b37cf430643b8818fbb7cb578051045de1615f0 WatchSource:0}: Error finding container 9554f62486f2385c001a4b509b37cf430643b8818fbb7cb578051045de1615f0: Status 404 returned error can't find the container with id 9554f62486f2385c001a4b509b37cf430643b8818fbb7cb578051045de1615f0
Jul 27 18:29:46.474363 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.474330    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:46.622040 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.621977    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-frdg6"]
Jul 27 18:29:46.624421 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:46.624385    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bef2d2a_5272_47a3_9d57_c245174f4cb7.slice/crio-d23e6a6c98e7874cb9b74046fe93782b72c1abfcf487895bdcded14537b404c1 WatchSource:0}: Error finding container d23e6a6c98e7874cb9b74046fe93782b72c1abfcf487895bdcded14537b404c1: Status 404 returned error can't find the container with id d23e6a6c98e7874cb9b74046fe93782b72c1abfcf487895bdcded14537b404c1
Jul 27 18:29:46.629234 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.629206    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frdg6" event={"ID":"1bef2d2a-5272-47a3-9d57-c245174f4cb7","Type":"ContainerStarted","Data":"d23e6a6c98e7874cb9b74046fe93782b72c1abfcf487895bdcded14537b404c1"}
Jul 27 18:29:46.630905 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.630880    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" event={"ID":"7edd4e95-7522-41a2-af44-b5dd1734489a","Type":"ContainerStarted","Data":"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"}
Jul 27 18:29:46.631005 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.630922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" event={"ID":"7edd4e95-7522-41a2-af44-b5dd1734489a","Type":"ContainerStarted","Data":"9554f62486f2385c001a4b509b37cf430643b8818fbb7cb578051045de1615f0"}
Jul 27 18:29:46.631068 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.631023    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:29:46.653700 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:46.653651    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" podStartSLOduration=37.653632169 podStartE2EDuration="37.653632169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:46.652792246 +0000 UTC m=+52.778646589" watchObservedRunningTime="2026-07-27 18:29:46.653632169 +0000 UTC m=+52.779486512"
Jul 27 18:29:47.483883 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:47.483544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:47.486851 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:47.486824    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a5210ea-1cf6-4807-b9df-bc386b4c2960-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zwb8j\" (UID: \"9a5210ea-1cf6-4807-b9df-bc386b4c2960\") " pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:47.549691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:47.549487    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zwb8j"
Jul 27 18:29:47.720790 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:47.720758    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zwb8j"]
Jul 27 18:29:47.728938 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:47.728911    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a5210ea_1cf6_4807_b9df_bc386b4c2960.slice/crio-140f20883c675377d8aecc59c579d7852f020705dd5cc4d354897d687f642e6a WatchSource:0}: Error finding container 140f20883c675377d8aecc59c579d7852f020705dd5cc4d354897d687f642e6a: Status 404 returned error can't find the container with id 140f20883c675377d8aecc59c579d7852f020705dd5cc4d354897d687f642e6a
Jul 27 18:29:48.637216 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:48.637177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8j" event={"ID":"9a5210ea-1cf6-4807-b9df-bc386b4c2960","Type":"ContainerStarted","Data":"140f20883c675377d8aecc59c579d7852f020705dd5cc4d354897d687f642e6a"}
Jul 27 18:29:49.643369 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:49.643335    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frdg6" event={"ID":"1bef2d2a-5272-47a3-9d57-c245174f4cb7","Type":"ContainerStarted","Data":"4132b4bdb9c27c25925523db06dc4193c5bdb2a39726beed4c86e09b4d18db5c"}
Jul 27 18:29:49.643816 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:49.643393    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-frdg6" event={"ID":"1bef2d2a-5272-47a3-9d57-c245174f4cb7","Type":"ContainerStarted","Data":"3a5332ca349d1a6d86c070c25158289de93edafed96f3769f2036d4e24487d24"}
Jul 27 18:29:49.643816 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:49.643505    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-frdg6"
Jul 27 18:29:49.663192 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:49.663152    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-frdg6" podStartSLOduration=17.434937927 podStartE2EDuration="19.663136429s" totalImagesPullingTime="2.228198502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:49.661371686 +0000 UTC m=+55.787226032" watchObservedRunningTime="2026-07-27 18:29:49.663136429 +0000 UTC m=+55.788990749"
Jul 27 18:29:53.659919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:53.659841    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8j" event={"ID":"9a5210ea-1cf6-4807-b9df-bc386b4c2960","Type":"ContainerStarted","Data":"cf0edb8835449ca6c3b64caf43333619402ed653cc6ef2fb1f6b4f1bc4e7a122"}
Jul 27 18:29:56.011682 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.011637    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:29:56.064480 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.064454    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"]
Jul 27 18:29:56.111350 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.111330    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"]
Jul 27 18:29:56.111503 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.111425    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147805 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-image-registry-private-configuration\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147819    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8n9t\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-kube-api-access-l8n9t\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147877    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-tls\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147907    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-trusted-ca\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-installation-pull-secrets\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.147978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.147950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-certificates\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.148170 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.148042    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-bound-sa-token\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.148170 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.148087    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-ca-trust-extracted\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248781 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248739    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-bound-sa-token\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-ca-trust-extracted\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-image-registry-private-configuration\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248862    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8n9t\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-kube-api-access-l8n9t\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248888    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-tls\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-trusted-ca\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.248949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248938    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-installation-pull-secrets\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.249296 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.248956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-certificates\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.249296 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.249129    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-ca-trust-extracted\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.249772 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.249747    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-certificates\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.249926 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.249902    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-trusted-ca\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.251738 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.251714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-registry-tls\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.252336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.252317    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-image-registry-private-configuration\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.252778 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.252748    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-installation-pull-secrets\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.259115 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.259091    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-bound-sa-token\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.262602 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.262532    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8n9t\" (UniqueName: \"kubernetes.io/projected/fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f-kube-api-access-l8n9t\") pod \"image-registry-5ddf9d4b7b-m79xl\" (UID: \"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f\") " pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.423223 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.423196    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:56.564523 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.564459    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-m6p7f"
Jul 27 18:29:56.913951 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:56.913924    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"]
Jul 27 18:29:56.916601 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:29:56.916579    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8fa7cc_98c1_429a_ac17_fe7d1e9c489f.slice/crio-ecf8bc14c59f03687b6314e3c3dd1ee67a43203a5a77a0fe8b200fcfb7b1e090 WatchSource:0}: Error finding container ecf8bc14c59f03687b6314e3c3dd1ee67a43203a5a77a0fe8b200fcfb7b1e090: Status 404 returned error can't find the container with id ecf8bc14c59f03687b6314e3c3dd1ee67a43203a5a77a0fe8b200fcfb7b1e090
Jul 27 18:29:57.674681 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:57.674633    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8j" event={"ID":"9a5210ea-1cf6-4807-b9df-bc386b4c2960","Type":"ContainerStarted","Data":"0dc3a2325a82731b0458fe89e0e60516bf44ada4b87ba0c4e064a51bd46dea5f"}
Jul 27 18:29:57.676740 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:57.676344    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl" event={"ID":"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f","Type":"ContainerStarted","Data":"99b8429951f9468912b6fbefce31a3e9aff061adc43f474398ff35149f68148b"}
Jul 27 18:29:57.676740 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:57.676391    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl" event={"ID":"fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f","Type":"ContainerStarted","Data":"ecf8bc14c59f03687b6314e3c3dd1ee67a43203a5a77a0fe8b200fcfb7b1e090"}
Jul 27 18:29:57.676740 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:57.676479    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:29:57.698305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:57.698240    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl" podStartSLOduration=1.698226953 podStartE2EDuration="1.698226953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:29:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:29:57.696679483 +0000 UTC m=+63.822533839" watchObservedRunningTime="2026-07-27 18:29:57.698226953 +0000 UTC m=+63.824081294"
Jul 27 18:29:59.649054 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:29:59.649019    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-frdg6"
Jul 27 18:30:00.083150 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.083104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:30:00.086273 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.086248    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 27 18:30:00.096147 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.096119    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/593730fd-24be-465e-8f73-b822268c39e7-metrics-certs\") pod \"network-metrics-daemon-ht6s2\" (UID: \"593730fd-24be-465e-8f73-b822268c39e7\") " pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:30:00.183691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.183659    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:30:00.186628 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.186611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 27 18:30:00.196636 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.196612    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/40a32a8f-1059-44c0-acaa-b8209ca2401a-original-pull-secret\") pod \"global-pull-secret-syncer-xfzx4\" (UID: \"40a32a8f-1059-44c0-acaa-b8209ca2401a\") " pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:30:00.284574 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.284553    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:30:00.287473 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.287455    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 27 18:30:00.298304 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.298288    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 27 18:30:00.308211 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.308186    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zxhb\" (UniqueName: \"kubernetes.io/projected/55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a-kube-api-access-9zxhb\") pod \"network-check-target-2wk79\" (UID: \"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a\") " pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:30:00.390912 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.390863    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fn8tb\""
Jul 27 18:30:00.396488 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.396475    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwbqc\""
Jul 27 18:30:00.398571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.398558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:30:00.399698 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.399682    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xfzx4"
Jul 27 18:30:00.404516 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.404499    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ht6s2"
Jul 27 18:30:00.546710 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.546682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2wk79"]
Jul 27 18:30:00.550399 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:00.550374    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55f4d88d_1b3b_47da_906d_8bf3dbbe2c3a.slice/crio-ad63a6d27680c9430986e1253cd46581d9563f6882e0d19185e56a349dbfa0f6 WatchSource:0}: Error finding container ad63a6d27680c9430986e1253cd46581d9563f6882e0d19185e56a349dbfa0f6: Status 404 returned error can't find the container with id ad63a6d27680c9430986e1253cd46581d9563f6882e0d19185e56a349dbfa0f6
Jul 27 18:30:00.559967 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.559944    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xfzx4"]
Jul 27 18:30:00.563324 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:00.563284    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a32a8f_1059_44c0_acaa_b8209ca2401a.slice/crio-78d57a7a7562e75314a31211fbacd59df62ffb87a58ef9a26bc5869a6dd870e7 WatchSource:0}: Error finding container 78d57a7a7562e75314a31211fbacd59df62ffb87a58ef9a26bc5869a6dd870e7: Status 404 returned error can't find the container with id 78d57a7a7562e75314a31211fbacd59df62ffb87a58ef9a26bc5869a6dd870e7
Jul 27 18:30:00.579112 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.579090    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ht6s2"]
Jul 27 18:30:00.582501 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:00.582480    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod593730fd_24be_465e_8f73_b822268c39e7.slice/crio-cc687c2b47767fac47e9d426d493b2a0d10b6b12e65a6149efc65a280037c17d WatchSource:0}: Error finding container cc687c2b47767fac47e9d426d493b2a0d10b6b12e65a6149efc65a280037c17d: Status 404 returned error can't find the container with id cc687c2b47767fac47e9d426d493b2a0d10b6b12e65a6149efc65a280037c17d
Jul 27 18:30:00.688489 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.688385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zwb8j" event={"ID":"9a5210ea-1cf6-4807-b9df-bc386b4c2960","Type":"ContainerStarted","Data":"a561b2985c1fbbbf57c33728b30f8e4b1cd3d308beb978408351e5b461204a96"}
Jul 27 18:30:00.689571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.689545    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfzx4" event={"ID":"40a32a8f-1059-44c0-acaa-b8209ca2401a","Type":"ContainerStarted","Data":"78d57a7a7562e75314a31211fbacd59df62ffb87a58ef9a26bc5869a6dd870e7"}
Jul 27 18:30:00.690673 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.690650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wk79" event={"ID":"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a","Type":"ContainerStarted","Data":"ad63a6d27680c9430986e1253cd46581d9563f6882e0d19185e56a349dbfa0f6"}
Jul 27 18:30:00.691693 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.691673    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht6s2" event={"ID":"593730fd-24be-465e-8f73-b822268c39e7","Type":"ContainerStarted","Data":"cc687c2b47767fac47e9d426d493b2a0d10b6b12e65a6149efc65a280037c17d"}
Jul 27 18:30:00.713088 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:00.713050    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zwb8j" podStartSLOduration=17.331381121 podStartE2EDuration="29.713034903s" totalImagesPullingTime="12.381653782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:29:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:00.71268022 +0000 UTC m=+66.838534562" watchObservedRunningTime="2026-07-27 18:30:00.713034903 +0000 UTC m=+66.838889244"
Jul 27 18:30:05.717949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.717911    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xfzx4" event={"ID":"40a32a8f-1059-44c0-acaa-b8209ca2401a","Type":"ContainerStarted","Data":"469d9208d34d9c74140d65b2a3e0b48f6574d293d5e0ea791a92e76cde1f6f8b"}
Jul 27 18:30:05.720951 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.720245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2wk79" event={"ID":"55f4d88d-1b3b-47da-906d-8bf3dbbe2c3a","Type":"ContainerStarted","Data":"c17acff76da9d14a94a778b58f55f6312bcf4cceab696bb52fbaa3d850ac280c"}
Jul 27 18:30:05.720951 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.720339    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:30:05.722395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.722374    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht6s2" event={"ID":"593730fd-24be-465e-8f73-b822268c39e7","Type":"ContainerStarted","Data":"6e2fb9d478cb4020a8a95038b3fc84eba8cf82934641ede8acc82797cc981fd8"}
Jul 27 18:30:05.722508 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.722407    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ht6s2" event={"ID":"593730fd-24be-465e-8f73-b822268c39e7","Type":"ContainerStarted","Data":"dca9182ae5c2ef63ec6af453baa1d768e330cef2be45e5c786c6c95c8418f117"}
Jul 27 18:30:05.735395 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.735358    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xfzx4" podStartSLOduration=66.809312243 podStartE2EDuration="1m11.735343686s" totalImagesPullingTime="4.926031443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:05.734224853 +0000 UTC m=+71.860079194" watchObservedRunningTime="2026-07-27 18:30:05.735343686 +0000 UTC m=+71.861198030"
Jul 27 18:30:05.752661 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.752609    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ht6s2" podStartSLOduration=66.842134995 podStartE2EDuration="1m11.752594623s" totalImagesPullingTime="4.910459628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:05.751665912 +0000 UTC m=+71.877520256" watchObservedRunningTime="2026-07-27 18:30:05.752594623 +0000 UTC m=+71.878448966"
Jul 27 18:30:05.772622 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:05.772574    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2wk79" podStartSLOduration=66.857371312 podStartE2EDuration="1m11.772562754s" totalImagesPullingTime="4.915191442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:28:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:05.772397556 +0000 UTC m=+71.898251899" watchObservedRunningTime="2026-07-27 18:30:05.772562754 +0000 UTC m=+71.898417096"
Jul 27 18:30:06.018006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:06.017977    2567 patch_prober.go:28] interesting pod/image-registry-6b7d8968d7-k2sq8 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 27 18:30:06.018114 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:06.018020    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:30:16.016632 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:16.016522    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:30:18.684312 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:18.684282    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5ddf9d4b7b-m79xl"
Jul 27 18:30:21.030747 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.030684    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerName="registry" containerID="cri-o://6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788" gracePeriod=30
Jul 27 18:30:21.276630 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.276606    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:30:21.423664 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423594    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423664 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423635    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423664 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423665    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423870 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423687    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423870 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423803    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mxtx\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423870 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423834    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.423870 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423857    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.424062 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.423897    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token\") pod \"7edd4e95-7522-41a2-af44-b5dd1734489a\" (UID: \"7edd4e95-7522-41a2-af44-b5dd1734489a\") "
Jul 27 18:30:21.424122 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.424055    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:30:21.424557 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.424524    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:30:21.426514 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.426465    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:30:21.426636 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.426547    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:30:21.426636 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.426612    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:30:21.426714 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.426680    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:30:21.426749 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.426736    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx" (OuterVolumeSpecName: "kube-api-access-5mxtx") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "kube-api-access-5mxtx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:30:21.432406 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.432383    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "7edd4e95-7522-41a2-af44-b5dd1734489a" (UID: "7edd4e95-7522-41a2-af44-b5dd1734489a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:30:21.525156 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525129    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mxtx\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-kube-api-access-5mxtx\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525156 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525153    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-installation-pull-secrets\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525162    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-certificates\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525171    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-bound-sa-token\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525180    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7edd4e95-7522-41a2-af44-b5dd1734489a-ca-trust-extracted\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525190    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7edd4e95-7522-41a2-af44-b5dd1734489a-registry-tls\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525199    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7edd4e95-7522-41a2-af44-b5dd1734489a-image-registry-private-configuration\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.525338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.525207    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7edd4e95-7522-41a2-af44-b5dd1734489a-trusted-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:30:21.777581 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.777552    2567 generic.go:356] "Generic (PLEG): container finished" podID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerID="6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788" exitCode=0
Jul 27 18:30:21.777680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.777600    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8"
Jul 27 18:30:21.777680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.777602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" event={"ID":"7edd4e95-7522-41a2-af44-b5dd1734489a","Type":"ContainerDied","Data":"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"}
Jul 27 18:30:21.777680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.777649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6b7d8968d7-k2sq8" event={"ID":"7edd4e95-7522-41a2-af44-b5dd1734489a","Type":"ContainerDied","Data":"9554f62486f2385c001a4b509b37cf430643b8818fbb7cb578051045de1615f0"}
Jul 27 18:30:21.777680 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.777669    2567 scope.go:117] "RemoveContainer" containerID="6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"
Jul 27 18:30:21.785798 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.785783    2567 scope.go:117] "RemoveContainer" containerID="6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"
Jul 27 18:30:21.786036 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:30:21.786019    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788\": container with ID starting with 6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788 not found: ID does not exist" containerID="6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"
Jul 27 18:30:21.786084 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.786044    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788"} err="failed to get container status \"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788\": rpc error: code = NotFound desc = could not find container \"6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788\": container with ID starting with 6a28116dec320d7164c5deccd63aa14f7caada2b007e9de0e695f91b9eeaf788 not found: ID does not exist"
Jul 27 18:30:21.798355 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.798334    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:30:21.803981 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:21.803962    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b7d8968d7-k2sq8"]
Jul 27 18:30:22.381120 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:22.381091    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" path="/var/lib/kubelet/pods/7edd4e95-7522-41a2-af44-b5dd1734489a/volumes"
Jul 27 18:30:30.479155 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.479119    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-v9rkt"]
Jul 27 18:30:30.479746 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.479427    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerName="registry"
Jul 27 18:30:30.479746 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.479458    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerName="registry"
Jul 27 18:30:30.479746 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.479519    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7edd4e95-7522-41a2-af44-b5dd1734489a" containerName="registry"
Jul 27 18:30:30.709578 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.709547    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.712691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.712641    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 27 18:30:30.712691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.712671    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 27 18:30:30.712908 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.712702    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 27 18:30:30.712908 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.712718    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 27 18:30:30.713864 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.713848    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 27 18:30:30.713980 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.713882    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6p8s5\""
Jul 27 18:30:30.713980 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.713893    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 27 18:30:30.781594 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781540    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-tls\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781594 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781763 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-root\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781763 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trsgq\" (UniqueName: \"kubernetes.io/projected/410ea204-9785-4eb4-9498-e83f900f8169-kube-api-access-trsgq\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781763 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-wtmp\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781763 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-metrics-client-ca\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781927 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781778    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781927 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781807    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-sys\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.781927 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.781838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-textfile\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.882854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.882830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-sys\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.882956 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.882860    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-textfile\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.882956 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.882892    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-tls\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883065 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.882952    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-sys\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883065 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883011    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883071    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-root\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883099    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trsgq\" (UniqueName: \"kubernetes.io/projected/410ea204-9785-4eb4-9498-e83f900f8169-kube-api-access-trsgq\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883142    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-wtmp\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-textfile\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-root\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883169    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-metrics-client-ca\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883223    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883616 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883394    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-wtmp\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883740 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-metrics-client-ca\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.883740 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.883732    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-accelerators-collector-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.885267 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.885241    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-tls\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.885662 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.885645    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/410ea204-9785-4eb4-9498-e83f900f8169-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:30.892115 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:30.892093    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trsgq\" (UniqueName: \"kubernetes.io/projected/410ea204-9785-4eb4-9498-e83f900f8169-kube-api-access-trsgq\") pod \"node-exporter-v9rkt\" (UID: \"410ea204-9785-4eb4-9498-e83f900f8169\") " pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:31.019245 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:31.019223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-v9rkt"
Jul 27 18:30:31.062009 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:31.061988    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod410ea204_9785_4eb4_9498_e83f900f8169.slice/crio-5cdf783f1b326b7a31e046a8e54c43289be59b9b6e8cb93d13af25faf2d2020a WatchSource:0}: Error finding container 5cdf783f1b326b7a31e046a8e54c43289be59b9b6e8cb93d13af25faf2d2020a: Status 404 returned error can't find the container with id 5cdf783f1b326b7a31e046a8e54c43289be59b9b6e8cb93d13af25faf2d2020a
Jul 27 18:30:31.815014 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:31.814974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9rkt" event={"ID":"410ea204-9785-4eb4-9498-e83f900f8169","Type":"ContainerStarted","Data":"5cdf783f1b326b7a31e046a8e54c43289be59b9b6e8cb93d13af25faf2d2020a"}
Jul 27 18:30:32.821051 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:32.820983    2567 generic.go:356] "Generic (PLEG): container finished" podID="410ea204-9785-4eb4-9498-e83f900f8169" containerID="dbcc8c3a122864c5223afc089eeff8c918d7f229a542caf261d734981091c350" exitCode=0
Jul 27 18:30:32.821394 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:32.821066    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9rkt" event={"ID":"410ea204-9785-4eb4-9498-e83f900f8169","Type":"ContainerDied","Data":"dbcc8c3a122864c5223afc089eeff8c918d7f229a542caf261d734981091c350"}
Jul 27 18:30:33.827049 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:33.827008    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9rkt" event={"ID":"410ea204-9785-4eb4-9498-e83f900f8169","Type":"ContainerStarted","Data":"df82fdc69f3aff38f890b0078753f0a357c0ac2398a83f72477805b2041d6733"}
Jul 27 18:30:33.827552 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:33.827062    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-v9rkt" event={"ID":"410ea204-9785-4eb4-9498-e83f900f8169","Type":"ContainerStarted","Data":"be15442369a46bde0ee921dff9a2fecd5c8361c10512c081a018a107a0999f0f"}
Jul 27 18:30:33.849912 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:33.849867    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-v9rkt" podStartSLOduration=2.348143979 podStartE2EDuration="3.849852214s" totalImagesPullingTime="1.430538496s" totalInitContainerRuntime="71.169739ms" isStatefulPod=true podCreationTimestamp="2026-07-27 18:30:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:33.849656452 +0000 UTC m=+99.975510800" watchObservedRunningTime="2026-07-27 18:30:33.849852214 +0000 UTC m=+99.975706556"
Jul 27 18:30:34.800521 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.800493    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-85ddc647bf-v5gbr"]
Jul 27 18:30:34.802654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.802639    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.805752 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.805726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 27 18:30:34.806936 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.806921    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-cpq1ttjfdidbq\""
Jul 27 18:30:34.807089 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.807068    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-vmpv6\""
Jul 27 18:30:34.807089 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.807080    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 27 18:30:34.807219 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.807075    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 27 18:30:34.807219 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.807201    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 27 18:30:34.815974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.815956    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85ddc647bf-v5gbr"]
Jul 27 18:30:34.911418 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911390    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefa6f45-636f-44d9-a451-ba514dd6c3bc-audit-log\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911742 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911420    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-metrics-server-audit-profiles\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911742 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911512    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-tls\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911742 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911742 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911698    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-client-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911742 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911715    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzwt\" (UniqueName: \"kubernetes.io/projected/fefa6f45-636f-44d9-a451-ba514dd6c3bc-kube-api-access-rpzwt\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:34.911911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:34.911784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-client-certs\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012687 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012656    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefa6f45-636f-44d9-a451-ba514dd6c3bc-audit-log\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012780 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012697    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-metrics-server-audit-profiles\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012780 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012721    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-tls\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012780 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012780 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012760    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-client-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012780 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzwt\" (UniqueName: \"kubernetes.io/projected/fefa6f45-636f-44d9-a451-ba514dd6c3bc-kube-api-access-rpzwt\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.012980 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.012961    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-client-certs\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.013154 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.013126    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/fefa6f45-636f-44d9-a451-ba514dd6c3bc-audit-log\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.013590 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.013567    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.013726 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.013708    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/fefa6f45-636f-44d9-a451-ba514dd6c3bc-metrics-server-audit-profiles\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.015373 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.015349    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-client-certs\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.015471 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.015372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-client-ca-bundle\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.015471 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.015372    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/fefa6f45-636f-44d9-a451-ba514dd6c3bc-secret-metrics-server-tls\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.022180 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.022161    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzwt\" (UniqueName: \"kubernetes.io/projected/fefa6f45-636f-44d9-a451-ba514dd6c3bc-kube-api-access-rpzwt\") pod \"metrics-server-85ddc647bf-v5gbr\" (UID: \"fefa6f45-636f-44d9-a451-ba514dd6c3bc\") " pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.111350 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.111303    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:35.242849 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.242822    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-85ddc647bf-v5gbr"]
Jul 27 18:30:35.244951 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:35.244926    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfefa6f45_636f_44d9_a451_ba514dd6c3bc.slice/crio-e7b0a4bb187b4c67d541be94fb374a33540b45771d391a31dc79ed7d7818c374 WatchSource:0}: Error finding container e7b0a4bb187b4c67d541be94fb374a33540b45771d391a31dc79ed7d7818c374: Status 404 returned error can't find the container with id e7b0a4bb187b4c67d541be94fb374a33540b45771d391a31dc79ed7d7818c374
Jul 27 18:30:35.258001 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.257981    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"]
Jul 27 18:30:35.260929 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.260910    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.263510 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.263492    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-svt6d\""
Jul 27 18:30:35.263619 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.263528    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 27 18:30:35.272618 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.272591    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"]
Jul 27 18:30:35.415945 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.415882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.416046 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.415955    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldkcb\" (UniqueName: \"kubernetes.io/projected/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-kube-api-access-ldkcb\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.517173 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.517144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldkcb\" (UniqueName: \"kubernetes.io/projected/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-kube-api-access-ldkcb\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.517288 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.517178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.517333 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:30:35.517311    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 18:30:35.517389 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:30:35.517378    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert podName:6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd nodeName:}" failed. No retries permitted until 2026-07-27 18:30:36.017360303 +0000 UTC m=+102.143214629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-stjbj" (UID: "6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd") : secret "monitoring-plugin-cert" not found
Jul 27 18:30:35.526700 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.526679    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldkcb\" (UniqueName: \"kubernetes.io/projected/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-kube-api-access-ldkcb\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:35.836235 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:35.836189    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr" event={"ID":"fefa6f45-636f-44d9-a451-ba514dd6c3bc","Type":"ContainerStarted","Data":"e7b0a4bb187b4c67d541be94fb374a33540b45771d391a31dc79ed7d7818c374"}
Jul 27 18:30:36.020345 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.020307    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:36.020793 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:30:36.020494    2567 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 27 18:30:36.020793 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:30:36.020573    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert podName:6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd nodeName:}" failed. No retries permitted until 2026-07-27 18:30:37.020552614 +0000 UTC m=+103.146406933 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-stjbj" (UID: "6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd") : secret "monitoring-plugin-cert" not found
Jul 27 18:30:36.733423 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.733395    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2wk79"
Jul 27 18:30:36.769225 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.769188    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:30:36.774517 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.774500    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.778518 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.778498    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 18:30:36.778627 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.778498    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 18:30:36.779275 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.779253    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 18:30:36.779412 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.779393    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 18:30:36.779556 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.779541    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 18:30:36.779745 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.779726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hgsc6\""
Jul 27 18:30:36.779819 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.779758    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 18:30:36.780241 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780181    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 18:30:36.780342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780297    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 18:30:36.780403 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780381    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c84k8c87comup\""
Jul 27 18:30:36.780478 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 18:30:36.781070 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780731    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 18:30:36.781070 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780783    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 18:30:36.781070 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.780967    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 18:30:36.782893 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.782844    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 18:30:36.787121 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.787106    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 18:30:36.792678 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.792660    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:30:36.841025 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.840993    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr" event={"ID":"fefa6f45-636f-44d9-a451-ba514dd6c3bc","Type":"ContainerStarted","Data":"33d216781af95482c61d5464299cb6c839119bf111db900b43392b94856448ef"}
Jul 27 18:30:36.865729 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.865687    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr" podStartSLOduration=1.578889403 podStartE2EDuration="2.865674796s" totalImagesPullingTime="1.286785393s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:30:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:36.863975292 +0000 UTC m=+102.989829638" watchObservedRunningTime="2026-07-27 18:30:36.865674796 +0000 UTC m=+102.991529137"
Jul 27 18:30:36.928668 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.928642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.928769 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.928671    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.928928 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.928909    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929009 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.928953    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929009 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.928980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929119 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929009    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929119 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929034    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929119 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929113    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929140    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929164    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929191    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929216    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929282 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929314    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929342    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929391    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929410    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:36.929533 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:36.929427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5tgm\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030292 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030314    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030345    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030373    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030502    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030537    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030605    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030627    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030655    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.030703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.030678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031546 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031384    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031546 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031579    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031654 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031641    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031814 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031814 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031814 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.031814 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031750    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5tgm\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.032017 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.031921    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.033658 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.032557    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.033658 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.032682    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.033658 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.033022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.033658 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.033351    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.034152 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.034124    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.034436 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.034408    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.034899 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.034872    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.035269 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.035245    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.035686 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.035662    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-stjbj\" (UID: \"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:37.036520 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.036501    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.037610 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.037049    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.037610 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.037130    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.037610 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.037576    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.037964 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.037947    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.038046 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.038026    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.038363 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.038334    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.038509 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.038477    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.038606 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.038590    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.041361 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.041336    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5tgm\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm\") pod \"prometheus-k8s-0\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.070278 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.070257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:37.085322 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.085304    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:37.209623 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.209589    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"]
Jul 27 18:30:37.212271 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:37.212242    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6811a1e7_5ad8_4bb7_a926_b08bb3bd4cdd.slice/crio-fc23bffc14b3e086c31e64400f85c09ca87c902800a966af1bd36dd54896a39f WatchSource:0}: Error finding container fc23bffc14b3e086c31e64400f85c09ca87c902800a966af1bd36dd54896a39f: Status 404 returned error can't find the container with id fc23bffc14b3e086c31e64400f85c09ca87c902800a966af1bd36dd54896a39f
Jul 27 18:30:37.237081 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.237011    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:30:37.240603 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:30:37.240582    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707649fb_3987_40ba_9f6e_98d647d208f6.slice/crio-f66ba746f6f42cf48caa25e114f4ac3793d931b16e7347ccdcefd0a37eaadf57 WatchSource:0}: Error finding container f66ba746f6f42cf48caa25e114f4ac3793d931b16e7347ccdcefd0a37eaadf57: Status 404 returned error can't find the container with id f66ba746f6f42cf48caa25e114f4ac3793d931b16e7347ccdcefd0a37eaadf57
Jul 27 18:30:37.847545 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.847504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"f66ba746f6f42cf48caa25e114f4ac3793d931b16e7347ccdcefd0a37eaadf57"}
Jul 27 18:30:37.849532 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:37.849495    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj" event={"ID":"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd","Type":"ContainerStarted","Data":"fc23bffc14b3e086c31e64400f85c09ca87c902800a966af1bd36dd54896a39f"}
Jul 27 18:30:39.857175 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.857141    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj" event={"ID":"6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd","Type":"ContainerStarted","Data":"0d9acbd0a82859c2eab19ddd416d73a9710e7009197fbe4b52c0162912fb20c5"}
Jul 27 18:30:39.857747 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.857274    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:39.858772 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.858744    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b" exitCode=0
Jul 27 18:30:39.858899 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.858787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"}
Jul 27 18:30:39.862873 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.862853    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj"
Jul 27 18:30:39.875926 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:39.875887    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-stjbj" podStartSLOduration=2.972529839 podStartE2EDuration="4.875873676s" totalImagesPullingTime="1.903343837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:39.874701405 +0000 UTC m=+106.000555749" watchObservedRunningTime="2026-07-27 18:30:39.875873676 +0000 UTC m=+106.001728018"
Jul 27 18:30:43.879249 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:43.879218    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"}
Jul 27 18:30:43.879618 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:43.879278    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"}
Jul 27 18:30:46.894343 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:46.894307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"}
Jul 27 18:30:46.894797 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:46.894420    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"}
Jul 27 18:30:46.894797 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:46.894526    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"}
Jul 27 18:30:46.894797 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:46.894567    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerStarted","Data":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"}
Jul 27 18:30:46.928634 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:46.928591    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.4168332550000002 podStartE2EDuration="10.92857804s" totalImagesPullingTime="7.494692519s" totalInitContainerRuntime="17.052266ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:30:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:30:46.927202047 +0000 UTC m=+113.053056406" watchObservedRunningTime="2026-07-27 18:30:46.92857804 +0000 UTC m=+113.054432381"
Jul 27 18:30:47.086417 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:47.086391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:30:55.112274 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:55.112235    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:30:55.112677 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:30:55.112319    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:31:15.116972 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:15.116946    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:31:15.120722 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:15.120697    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-85ddc647bf-v5gbr"
Jul 27 18:31:37.085703 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:37.085675    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:37.105335 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:37.105313    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:38.085030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:38.085004    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:55.121410 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121332    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121685    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="prometheus" containerID="cri-o://271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b" gracePeriod=600
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121688    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-web" containerID="cri-o://0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd" gracePeriod=600
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121713    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9" gracePeriod=600
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121751    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="thanos-sidecar" containerID="cri-o://b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835" gracePeriod=600
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121740    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy" containerID="cri-o://c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca" gracePeriod=600
Jul 27 18:31:55.121911 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.121837    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="config-reloader" containerID="cri-o://1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d" gracePeriod=600
Jul 27 18:31:55.367618 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.367595    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:55.501479 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501437    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501491    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501530    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501556    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5tgm\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501582    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501605    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.501937 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501911    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.501994 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.501970    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502046 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502004    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.502046 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502021    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.502046 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502013    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502202 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502049    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.502202 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502098    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502294 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502238    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.502294 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502128    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502471    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502422    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502519    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502545    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502568    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502620    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502647    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.502711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502680    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502735    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502770    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs\") pod \"707649fb-3987-40ba-9f6e-98d647d208f6\" (UID: \"707649fb-3987-40ba-9f6e-98d647d208f6\") "
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502878    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.502991    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503009    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-metrics-client-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503022    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503035    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503050    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503062    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.503340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.503075    2567 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/707649fb-3987-40ba-9f6e-98d647d208f6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.504719 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.504684    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.504835 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.504746    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm" (OuterVolumeSpecName: "kube-api-access-x5tgm") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "kube-api-access-x5tgm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:31:55.504993 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.504964    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.505082 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.505061    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config" (OuterVolumeSpecName: "config") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.505338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.505314    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:31:55.505709 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.505646    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.505914 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.505872    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.506279 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.506241    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.506374 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.506309    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:31:55.506929 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.506906    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out" (OuterVolumeSpecName: "config-out") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 27 18:31:55.507148 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.507127    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.507338 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.507323    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.516283 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.516265    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config" (OuterVolumeSpecName: "web-config") pod "707649fb-3987-40ba-9f6e-98d647d208f6" (UID: "707649fb-3987-40ba-9f6e-98d647d208f6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 27 18:31:55.604149 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604127    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5tgm\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-kube-api-access-x5tgm\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604149 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604148    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604158    2567 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-config\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604168    2567 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-grpc-tls\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604177    2567 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604185    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/707649fb-3987-40ba-9f6e-98d647d208f6-tls-assets\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604192    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604200    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-config-out\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604207    2567 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/707649fb-3987-40ba-9f6e-98d647d208f6-prometheus-k8s-db\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604215    2567 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-kube-rbac-proxy\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604223    2567 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604231    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-web-config\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:55.604260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:55.604239    2567 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/707649fb-3987-40ba-9f6e-98d647d208f6-secret-metrics-client-certs\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:31:56.142711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142677    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9" exitCode=0
Jul 27 18:31:56.142711 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142712    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca" exitCode=0
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142722    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd" exitCode=0
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142730    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835" exitCode=0
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142735    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d" exitCode=0
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142740    2567 generic.go:356] "Generic (PLEG): container finished" podID="707649fb-3987-40ba-9f6e-98d647d208f6" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b" exitCode=0
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"}
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142826    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142845    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.142834    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"}
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.143091    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"}
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.143146    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"}
Jul 27 18:31:56.143194 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.143188    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"}
Jul 27 18:31:56.143725 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.143230    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"}
Jul 27 18:31:56.143725 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.143289    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"707649fb-3987-40ba-9f6e-98d647d208f6","Type":"ContainerDied","Data":"f66ba746f6f42cf48caa25e114f4ac3793d931b16e7347ccdcefd0a37eaadf57"}
Jul 27 18:31:56.151950 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.151932    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.158974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.158957    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.166001 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.165962    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.167546 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.167523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:56.173424 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.173396    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:56.173933 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.173916    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.182160 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.182135    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.191026 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.191003    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.198332 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198295    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:56.198590 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198576    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-web"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198592    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-web"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198600    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198606    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198620    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="prometheus"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198626    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="prometheus"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198632    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="config-reloader"
Jul 27 18:31:56.198640 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198637    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="config-reloader"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198644    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="init-config-reloader"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198649    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="init-config-reloader"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198654    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="thanos-sidecar"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198659    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="thanos-sidecar"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198670    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-thanos"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198675    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-thanos"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198732    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="config-reloader"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198739    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="thanos-sidecar"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198745    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-web"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198750    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198757    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="prometheus"
Jul 27 18:31:56.198840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.198762    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" containerName="kube-rbac-proxy-thanos"
Jul 27 18:31:56.199281 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.199210    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.199662 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.199633    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.199750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.199676    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.199750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.199702    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.200031 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.200010    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.200101 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200042    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.200101 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200070    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.200337 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.200315    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.200480 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200342    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.200480 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200362    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.200689 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.200667    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.200750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200696    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.200750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.200711    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.201012 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.200996    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.201087 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201013    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.201087 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201026    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.201269 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.201246    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.201421 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201272    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.201421 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201291    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.201591 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:31:56.201570    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.201665 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201591    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.201665 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201604    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.201823 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201808    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.201868 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.201825    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.202069 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202050    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.202069 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202067    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.202319 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202302    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.202370 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202320    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.202612 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202584    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.202675 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202616    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.202874 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202854    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.202931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.202875    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.203081 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203062    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.203184 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203098    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.203184 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203126    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.203367 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203332    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.203367 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203366    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.203795 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203770    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.203881 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.203795    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.204055 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204036    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.204128 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204056    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.204322 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204304    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.204393 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204324    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.204647 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204629    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.204647 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204646    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.204936 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204915    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.204999 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.204938    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.205191 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205174    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.205237 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205191    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.205473 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205432    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.205544 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205474    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.205699 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205678    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.205753 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205701    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.205905 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205890    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 27 18:31:56.205974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205952    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.206030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205974    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.206030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.205891    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 27 18:31:56.206367 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206349    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 27 18:31:56.206455 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206410    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.206455 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206434    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.206573 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206502    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 27 18:31:56.206624 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206602    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 27 18:31:56.206624 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206611    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 27 18:31:56.206624 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206617    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c84k8c87comup\""
Jul 27 18:31:56.206765 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 27 18:31:56.206765 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.206708    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 27 18:31:56.207019 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207000    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.207071 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207024    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.207277 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207256    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hgsc6\""
Jul 27 18:31:56.207388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207258    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 27 18:31:56.207388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207293    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.207388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207331    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.207388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207335    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 27 18:31:56.207725 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207701    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.207799 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.207729    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.208034 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208008    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.208111 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208037    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.208111 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208025    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 27 18:31:56.208610 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208590    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 27 18:31:56.208737 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208699    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.208737 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.208718    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.209030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209006    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.209030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209031    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.209311 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209276    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.209311 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209312    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.209700 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209677    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.209773 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.209703    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.210078 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.210053    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.210078 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.210078    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.210369 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.210336    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.210369 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.210370    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.210694 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.210674    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 27 18:31:56.211200 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211172    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.211200 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211199    2567 scope.go:117] "RemoveContainer" containerID="be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"
Jul 27 18:31:56.211512 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211460    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9"} err="failed to get container status \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": rpc error: code = NotFound desc = could not find container \"be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9\": container with ID starting with be04e720864b291636782d7706a6fa9e8f5767e64cf579980e50fc2b47ca1fa9 not found: ID does not exist"
Jul 27 18:31:56.211512 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211488    2567 scope.go:117] "RemoveContainer" containerID="c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"
Jul 27 18:31:56.211871 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211747    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca"} err="failed to get container status \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": rpc error: code = NotFound desc = could not find container \"c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca\": container with ID starting with c92a167d00074a2ff651650cc6abcf53c8d8c56a484f45a907cdfe4650ce74ca not found: ID does not exist"
Jul 27 18:31:56.211871 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.211798    2567 scope.go:117] "RemoveContainer" containerID="0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"
Jul 27 18:31:56.212219 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212193    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd"} err="failed to get container status \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": rpc error: code = NotFound desc = could not find container \"0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd\": container with ID starting with 0acfc027ca8f8fdc98aac57bb4ee7930fdfb10a0b3c0c48ccaeee69dbb9733cd not found: ID does not exist"
Jul 27 18:31:56.212325 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212221    2567 scope.go:117] "RemoveContainer" containerID="b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"
Jul 27 18:31:56.212515 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212493    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835"} err="failed to get container status \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": rpc error: code = NotFound desc = could not find container \"b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835\": container with ID starting with b031d4c859956b4251e696933ae09d9a2175659848c1b694bdfbe1acdfdd1835 not found: ID does not exist"
Jul 27 18:31:56.212570 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212518    2567 scope.go:117] "RemoveContainer" containerID="1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"
Jul 27 18:31:56.212617 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212573    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 27 18:31:56.212783 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212759    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d"} err="failed to get container status \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": rpc error: code = NotFound desc = could not find container \"1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d\": container with ID starting with 1dfac96bec122b827a36b48b6b4de81ad3a220ec229af943d7a7cf29eb8fe48d not found: ID does not exist"
Jul 27 18:31:56.212841 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.212787    2567 scope.go:117] "RemoveContainer" containerID="271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"
Jul 27 18:31:56.213038 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.213020    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b"} err="failed to get container status \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": rpc error: code = NotFound desc = could not find container \"271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b\": container with ID starting with 271aa472679bd560d6b97f81ce056f665a10b7a48d63257b56291b6a1202254b not found: ID does not exist"
Jul 27 18:31:56.213132 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.213039    2567 scope.go:117] "RemoveContainer" containerID="20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"
Jul 27 18:31:56.213281 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.213264    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b"} err="failed to get container status \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": rpc error: code = NotFound desc = could not find container \"20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b\": container with ID starting with 20382f99fee96a6fecde605c672f8738d438e3f8f40fda702a010d909e6a681b not found: ID does not exist"
Jul 27 18:31:56.220511 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.220426    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:56.307328 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307328 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307332    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307532 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307364    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307532 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307406    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307532 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307490    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307532 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307511    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307537    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307595    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrd66\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-kube-api-access-wrd66\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307636    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307672    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.307733 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307710    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307737    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307763    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307814    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307874    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307926    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.308006 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.307947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.381502 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.381478    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="707649fb-3987-40ba-9f6e-98d647d208f6" path="/var/lib/kubelet/pods/707649fb-3987-40ba-9f6e-98d647d208f6/volumes"
Jul 27 18:31:56.408250 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408250 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408250 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408420 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408252    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408420 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408273    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408420 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408289    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408605 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrd66\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-kube-api-access-wrd66\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408605 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408605 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408540    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408605 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408601    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408638    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408665    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408690    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.408793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.408716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409606    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409680    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409742    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.409843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.410853 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.410211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.412582 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.411773    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.413264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.412901    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.413264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.412900    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.413264 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413009    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e7a07edf-1fcf-4182-a7ae-a78c8853588e-config-out\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.413496 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413284    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-web-config\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.413566 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413543    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.414032 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413740    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.414032 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413794    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.414032 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.413808    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.414253 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.414058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.415262 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.414530    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.415262 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.414790    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.415262 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.415180    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.415840 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.415813    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.416185 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.416166    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.419234 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.417507    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrd66\" (UniqueName: \"kubernetes.io/projected/e7a07edf-1fcf-4182-a7ae-a78c8853588e-kube-api-access-wrd66\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.419234 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.417714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e7a07edf-1fcf-4182-a7ae-a78c8853588e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.419234 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.418798    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.420067 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.420050    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e7a07edf-1fcf-4182-a7ae-a78c8853588e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e7a07edf-1fcf-4182-a7ae-a78c8853588e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.515248 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.515227    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:31:56.654545 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:56.654406    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 27 18:31:56.656837 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:31:56.656802    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7a07edf_1fcf_4182_a7ae_a78c8853588e.slice/crio-8f0018427e1b10b21ac32b04119bb40e2a2b4b440696d396cb5f4069b6f2d44d WatchSource:0}: Error finding container 8f0018427e1b10b21ac32b04119bb40e2a2b4b440696d396cb5f4069b6f2d44d: Status 404 returned error can't find the container with id 8f0018427e1b10b21ac32b04119bb40e2a2b4b440696d396cb5f4069b6f2d44d
Jul 27 18:31:57.147157 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:57.147124    2567 generic.go:356] "Generic (PLEG): container finished" podID="e7a07edf-1fcf-4182-a7ae-a78c8853588e" containerID="0214f25cbadd0c0f3da5b36f8dff9aa95993c0335dc4bdde68b6ecdfd2cfe441" exitCode=0
Jul 27 18:31:57.147504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:57.147205    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerDied","Data":"0214f25cbadd0c0f3da5b36f8dff9aa95993c0335dc4bdde68b6ecdfd2cfe441"}
Jul 27 18:31:57.147504 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:57.147273    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"8f0018427e1b10b21ac32b04119bb40e2a2b4b440696d396cb5f4069b6f2d44d"}
Jul 27 18:31:58.154722 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"1a4f15dcb4e8e2cf1216ce19c676b1fa1acd8ea8acff1415fa862593e0fc04c5"}
Jul 27 18:31:58.155131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154768    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"5f1e85774a47439fcc7dc35aa06b92d2b8908d3783bc9af99e8e81e0fa65ca69"}
Jul 27 18:31:58.155131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154813    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"469cbaf36ea9a5296185cc2992253284cdfa11120458ee232514c0e83d62a0df"}
Jul 27 18:31:58.155131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154859    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"e8bff0f4a87e805cbc0fce424f0616ce415ea9ea9feae84a233452b4f89c7700"}
Jul 27 18:31:58.155131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"111989cf98b5f57d48a5d736ddd726273f2d58363c89903d87897ccdc2cb9a42"}
Jul 27 18:31:58.155131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.154939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e7a07edf-1fcf-4182-a7ae-a78c8853588e","Type":"ContainerStarted","Data":"60eac03c72b5359274a6f769e37e8aa0a615d97e060fe6d463a9c6571b85eb18"}
Jul 27 18:31:58.186616 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:31:58.186577    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.1673873710000002 podStartE2EDuration="2.186562004s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.174633ms" isStatefulPod=false podCreationTimestamp="2026-07-27 18:31:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:31:58.185218692 +0000 UTC m=+184.311073034" watchObservedRunningTime="2026-07-27 18:31:58.186562004 +0000 UTC m=+184.312416345"
Jul 27 18:32:01.515814 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:32:01.515774    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:32:56.515925 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:32:56.515894    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:32:56.530809 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:32:56.530788    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:32:57.372039 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:32:57.372013    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 27 18:33:54.275908 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:33:54.275879    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 27 18:34:57.925078 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.924997    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"]
Jul 27 18:34:57.927154 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.927140    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:57.929918 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.929899    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z9lgh\""
Jul 27 18:34:57.930030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.929941    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 27 18:34:57.930030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.929951    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 27 18:34:57.938347 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.938325    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:57.938480 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.938392    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppcjw\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-kube-api-access-ppcjw\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:57.939638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:57.939612    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"]
Jul 27 18:34:58.039762 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.039731    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:58.039915 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.039775    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppcjw\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-kube-api-access-ppcjw\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:58.049184 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.049163    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:58.049384 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.049362    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppcjw\" (UniqueName: \"kubernetes.io/projected/9c8ed44d-0a91-476a-a450-4f92822fa609-kube-api-access-ppcjw\") pod \"cert-manager-cainjector-559cdd8c87-nk5rm\" (UID: \"9c8ed44d-0a91-476a-a450-4f92822fa609\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:58.249133 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.249104    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"
Jul 27 18:34:58.380107 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:34:58.380065    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c8ed44d_0a91_476a_a450_4f92822fa609.slice/crio-2caf33d02faae7b550be3ccb11c50018657b581370312459e11527614e9f9906 WatchSource:0}: Error finding container 2caf33d02faae7b550be3ccb11c50018657b581370312459e11527614e9f9906: Status 404 returned error can't find the container with id 2caf33d02faae7b550be3ccb11c50018657b581370312459e11527614e9f9906
Jul 27 18:34:58.382143 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.382045    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm"]
Jul 27 18:34:58.382348 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.382332    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:34:58.750366 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:34:58.750330    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm" event={"ID":"9c8ed44d-0a91-476a-a450-4f92822fa609","Type":"ContainerStarted","Data":"2caf33d02faae7b550be3ccb11c50018657b581370312459e11527614e9f9906"}
Jul 27 18:35:02.768195 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:02.768157    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm" event={"ID":"9c8ed44d-0a91-476a-a450-4f92822fa609","Type":"ContainerStarted","Data":"6e23c94ce98ec9c21e07384eb99b80ba7d80fec190fe6139975a02af265d3b4e"}
Jul 27 18:35:02.801836 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:02.801791    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-nk5rm" podStartSLOduration=2.419523194 podStartE2EDuration="5.801777629s" totalImagesPullingTime="3.382254435s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:34:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:35:02.801549313 +0000 UTC m=+368.927403655" watchObservedRunningTime="2026-07-27 18:35:02.801777629 +0000 UTC m=+368.927631971"
Jul 27 18:35:13.568293 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.568265    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"]
Jul 27 18:35:13.570500 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.570484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.573059 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.573041    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-sgk5p\""
Jul 27 18:35:13.574326 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.574295    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 27 18:35:13.574326 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.574313    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 27 18:35:13.581246 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.581226    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"]
Jul 27 18:35:13.659359 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.659328    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71f0c127-baab-4f50-90a7-5e37ae771d50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.659521 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.659384    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jrxr\" (UniqueName: \"kubernetes.io/projected/71f0c127-baab-4f50-90a7-5e37ae771d50-kube-api-access-9jrxr\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.759955 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.759915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71f0c127-baab-4f50-90a7-5e37ae771d50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.760130 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.759998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jrxr\" (UniqueName: \"kubernetes.io/projected/71f0c127-baab-4f50-90a7-5e37ae771d50-kube-api-access-9jrxr\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.760286 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.760262    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71f0c127-baab-4f50-90a7-5e37ae771d50-tmp\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.768750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.768727    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jrxr\" (UniqueName: \"kubernetes.io/projected/71f0c127-baab-4f50-90a7-5e37ae771d50-kube-api-access-9jrxr\") pod \"openshift-lws-operator-fd8ccff4c-lwhw2\" (UID: \"71f0c127-baab-4f50-90a7-5e37ae771d50\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:13.878633 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:13.878551    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"
Jul 27 18:35:14.003764 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:14.003731    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2"]
Jul 27 18:35:14.006966 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:35:14.006937    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod71f0c127_baab_4f50_90a7_5e37ae771d50.slice/crio-e2c7673d1ebf04f9f7b1b23a54dfad9629f3bd43a7ed869fb321a3edc38f9bc3 WatchSource:0}: Error finding container e2c7673d1ebf04f9f7b1b23a54dfad9629f3bd43a7ed869fb321a3edc38f9bc3: Status 404 returned error can't find the container with id e2c7673d1ebf04f9f7b1b23a54dfad9629f3bd43a7ed869fb321a3edc38f9bc3
Jul 27 18:35:14.810929 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:14.810895    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2" event={"ID":"71f0c127-baab-4f50-90a7-5e37ae771d50","Type":"ContainerStarted","Data":"e2c7673d1ebf04f9f7b1b23a54dfad9629f3bd43a7ed869fb321a3edc38f9bc3"}
Jul 27 18:35:16.820635 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:16.820603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2" event={"ID":"71f0c127-baab-4f50-90a7-5e37ae771d50","Type":"ContainerStarted","Data":"09ed15c6e36dc8f21bf56be88125af35d71c9d279825a7059ee25a9636f97a84"}
Jul 27 18:35:16.840157 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:16.840102    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-lwhw2" podStartSLOduration=1.181435078 podStartE2EDuration="3.840088806s" totalImagesPullingTime="2.658653728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:35:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:35:16.837735713 +0000 UTC m=+382.963590056" watchObservedRunningTime="2026-07-27 18:35:16.840088806 +0000 UTC m=+382.965943147"
Jul 27 18:35:32.578017 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.577987    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"]
Jul 27 18:35:32.581451 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.581421    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.584721 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.584694    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 27 18:35:32.585124 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.585108    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dvvg4\""
Jul 27 18:35:32.585400 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.585386    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 27 18:35:32.586213 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.586197    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 27 18:35:32.588983 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.588966    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 27 18:35:32.603521 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.603501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"]
Jul 27 18:35:32.712900 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.712870    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.713094 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.712928    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqdcb\" (UniqueName: \"kubernetes.io/projected/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-kube-api-access-mqdcb\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.713094 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.712966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-tmp\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.713094 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.712992    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-manifests\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.713094 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.713014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814256 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814223    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqdcb\" (UniqueName: \"kubernetes.io/projected/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-kube-api-access-mqdcb\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814256 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814261    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-tmp\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814433 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-manifests\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814433 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814305    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814433 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814366    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.814671 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.814652    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-manifests\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.816796 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.816770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-tmp\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.816931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.816904    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.817009 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.816993    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-webhook-cert\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.822598 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.822575    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqdcb\" (UniqueName: \"kubernetes.io/projected/30bd9678-8e3e-40e9-9081-1e0aaa795d8a-kube-api-access-mqdcb\") pod \"opendatahub-operator-controller-manager-57d99c84d4-xgnmr\" (UID: \"30bd9678-8e3e-40e9-9081-1e0aaa795d8a\") " pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:32.891161 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:32.891094    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:33.023174 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:33.023046    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"]
Jul 27 18:35:33.026094 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:35:33.026064    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30bd9678_8e3e_40e9_9081_1e0aaa795d8a.slice/crio-d75fc498a100828c185d35e3d33a522ad8b39934d2939f69ac1e3814c17fe8c3 WatchSource:0}: Error finding container d75fc498a100828c185d35e3d33a522ad8b39934d2939f69ac1e3814c17fe8c3: Status 404 returned error can't find the container with id d75fc498a100828c185d35e3d33a522ad8b39934d2939f69ac1e3814c17fe8c3
Jul 27 18:35:33.879789 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:33.879754    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr" event={"ID":"30bd9678-8e3e-40e9-9081-1e0aaa795d8a","Type":"ContainerStarted","Data":"d75fc498a100828c185d35e3d33a522ad8b39934d2939f69ac1e3814c17fe8c3"}
Jul 27 18:35:36.892856 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:36.892822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr" event={"ID":"30bd9678-8e3e-40e9-9081-1e0aaa795d8a","Type":"ContainerStarted","Data":"8e49e3475dbf3b45906e577886357c7bd143e2b9e745ee83e6579e21dc6508aa"}
Jul 27 18:35:37.897834 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:37.897795    2567 generic.go:356] "Generic (PLEG): container finished" podID="30bd9678-8e3e-40e9-9081-1e0aaa795d8a" containerID="8e49e3475dbf3b45906e577886357c7bd143e2b9e745ee83e6579e21dc6508aa" exitCode=0
Jul 27 18:35:37.898210 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:37.897861    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr" event={"ID":"30bd9678-8e3e-40e9-9081-1e0aaa795d8a","Type":"ContainerDied","Data":"8e49e3475dbf3b45906e577886357c7bd143e2b9e745ee83e6579e21dc6508aa"}
Jul 27 18:35:38.904274 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:38.904235    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr" event={"ID":"30bd9678-8e3e-40e9-9081-1e0aaa795d8a","Type":"ContainerStarted","Data":"1753e16b2bc605cd4bf993fcebe6805089ac05dcf3bd680348ff5993f9929023"}
Jul 27 18:35:38.904770 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:38.904363    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:38.940214 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:38.940167    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr" podStartSLOduration=2.174954914 podStartE2EDuration="6.940147691s" totalImagesPullingTime="3.75238773s" totalInitContainerRuntime="1.012805047s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:35:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:35:38.938554145 +0000 UTC m=+405.064408486" watchObservedRunningTime="2026-07-27 18:35:38.940147691 +0000 UTC m=+405.066002034"
Jul 27 18:35:49.910203 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:49.910166    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57d99c84d4-xgnmr"
Jul 27 18:35:53.088295 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.088260    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"]
Jul 27 18:35:53.094253 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.094231    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.099928 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.099902    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 27 18:35:53.101342 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.101320    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 27 18:35:53.102638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.102620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-xr9vw\""
Jul 27 18:35:53.103107 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.103092    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 27 18:35:53.118982 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.118963    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"]
Jul 27 18:35:53.176948 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.176916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-metrics-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.176948 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.176948    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq7sm\" (UniqueName: \"kubernetes.io/projected/27fb38c0-fb57-4c7f-9bde-8b261578a403-kube-api-access-hq7sm\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.177161 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.176970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.177161 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.177080    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27fb38c0-fb57-4c7f-9bde-8b261578a403-manager-config\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.277652 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.277622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27fb38c0-fb57-4c7f-9bde-8b261578a403-manager-config\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.277831 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.277698    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-metrics-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.277831 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.277726    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq7sm\" (UniqueName: \"kubernetes.io/projected/27fb38c0-fb57-4c7f-9bde-8b261578a403-kube-api-access-hq7sm\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.277831 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.277752    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.278427 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.278400    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27fb38c0-fb57-4c7f-9bde-8b261578a403-manager-config\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.280314 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.280292    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-metrics-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.280503 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.280483    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27fb38c0-fb57-4c7f-9bde-8b261578a403-cert\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.287185 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.287165    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq7sm\" (UniqueName: \"kubernetes.io/projected/27fb38c0-fb57-4c7f-9bde-8b261578a403-kube-api-access-hq7sm\") pod \"lws-controller-manager-7cc45b746b-jzcn6\" (UID: \"27fb38c0-fb57-4c7f-9bde-8b261578a403\") " pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.404494 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.404370    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:53.554142 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.553872    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"]
Jul 27 18:35:53.556969 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:35:53.556926    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27fb38c0_fb57_4c7f_9bde_8b261578a403.slice/crio-4ef1b3bc3b07243e90844ed9e39e45f5d04d44fa00988856e9b490f4327f7496 WatchSource:0}: Error finding container 4ef1b3bc3b07243e90844ed9e39e45f5d04d44fa00988856e9b490f4327f7496: Status 404 returned error can't find the container with id 4ef1b3bc3b07243e90844ed9e39e45f5d04d44fa00988856e9b490f4327f7496
Jul 27 18:35:53.959629 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:53.959592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6" event={"ID":"27fb38c0-fb57-4c7f-9bde-8b261578a403","Type":"ContainerStarted","Data":"4ef1b3bc3b07243e90844ed9e39e45f5d04d44fa00988856e9b490f4327f7496"}
Jul 27 18:35:54.836748 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.836708    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vc8p9"]
Jul 27 18:35:54.839327 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.839282    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:54.841937 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.841903    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 27 18:35:54.842070 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.841958    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2chn6\""
Jul 27 18:35:54.858198 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.858141    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vc8p9"]
Jul 27 18:35:54.992619 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.992579    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92v7p\" (UniqueName: \"kubernetes.io/projected/8b90f79d-8e9d-4a32-8f23-1a85e475459a-kube-api-access-92v7p\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:54.992816 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:54.992669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.093272 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.093167    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92v7p\" (UniqueName: \"kubernetes.io/projected/8b90f79d-8e9d-4a32-8f23-1a85e475459a-kube-api-access-92v7p\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.093467 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.093279    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.093542 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:35:55.093469    2567 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 27 18:35:55.093608 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:35:55.093547    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs podName:8b90f79d-8e9d-4a32-8f23-1a85e475459a nodeName:}" failed. No retries permitted until 2026-07-27 18:35:55.593525346 +0000 UTC m=+421.719379672 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs") pod "model-serving-api-54d89bd5fc-vc8p9" (UID: "8b90f79d-8e9d-4a32-8f23-1a85e475459a") : secret "model-serving-api-tls" not found
Jul 27 18:35:55.102721 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.102691    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92v7p\" (UniqueName: \"kubernetes.io/projected/8b90f79d-8e9d-4a32-8f23-1a85e475459a-kube-api-access-92v7p\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.598747 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.598709    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.601233 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.601211    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8b90f79d-8e9d-4a32-8f23-1a85e475459a-tls-certs\") pod \"model-serving-api-54d89bd5fc-vc8p9\" (UID: \"8b90f79d-8e9d-4a32-8f23-1a85e475459a\") " pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.751669 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.751638    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:55.883556 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.883484    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vc8p9"]
Jul 27 18:35:55.887046 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:35:55.887015    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b90f79d_8e9d_4a32_8f23_1a85e475459a.slice/crio-f48e1a0159e2da50ceebe5ca0e6fcb41e0feea567bbb1f2fbb723d2388ad04d6 WatchSource:0}: Error finding container f48e1a0159e2da50ceebe5ca0e6fcb41e0feea567bbb1f2fbb723d2388ad04d6: Status 404 returned error can't find the container with id f48e1a0159e2da50ceebe5ca0e6fcb41e0feea567bbb1f2fbb723d2388ad04d6
Jul 27 18:35:55.969865 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.969822    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9" event={"ID":"8b90f79d-8e9d-4a32-8f23-1a85e475459a","Type":"ContainerStarted","Data":"f48e1a0159e2da50ceebe5ca0e6fcb41e0feea567bbb1f2fbb723d2388ad04d6"}
Jul 27 18:35:55.971245 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.971224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6" event={"ID":"27fb38c0-fb57-4c7f-9bde-8b261578a403","Type":"ContainerStarted","Data":"2aa3d263557fd64af0d4f34d5446d815830367a305ccda7f153c9b70a71936aa"}
Jul 27 18:35:55.971385 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.971373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:35:55.991783 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:55.991735    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6" podStartSLOduration=1.340339609 podStartE2EDuration="2.991720634s" totalImagesPullingTime="1.651381025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:35:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:35:55.99071916 +0000 UTC m=+422.116573504" watchObservedRunningTime="2026-07-27 18:35:55.991720634 +0000 UTC m=+422.117574975"
Jul 27 18:35:58.987661 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:58.987626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9" event={"ID":"8b90f79d-8e9d-4a32-8f23-1a85e475459a","Type":"ContainerStarted","Data":"3d7f50579df74bf26e6d2c74dd5b60ffb94c6f50d39fe1c21aa4d18ff03949b0"}
Jul 27 18:35:58.988060 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:58.987727    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:35:59.006020 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:35:59.005956    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9" podStartSLOduration=2.954744095 podStartE2EDuration="5.005929595s" totalImagesPullingTime="2.0511855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:35:59.005687739 +0000 UTC m=+425.131542082" watchObservedRunningTime="2026-07-27 18:35:59.005929595 +0000 UTC m=+425.131783939"
Jul 27 18:36:01.108352 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.108318    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"]
Jul 27 18:36:01.110587 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.110572    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.113428 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113401    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 27 18:36:01.113428 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113427    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 27 18:36:01.113621 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113412    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 27 18:36:01.113621 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113556    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 27 18:36:01.113729 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113622    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-mw2c8\""
Jul 27 18:36:01.113729 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113628    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 27 18:36:01.113827 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.113814    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 27 18:36:01.125779 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.125759    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"]
Jul 27 18:36:01.248571 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248541    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248587    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248614    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d459z\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-kube-api-access-d459z\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248727    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.248940 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.248768    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.349884 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.349837    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350038 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.349898    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350038 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.349925    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d459z\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-kube-api-access-d459z\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350038 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.349980    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350186 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.350109    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350186 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.350151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.350281 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.350189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.351044 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.351014    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.352332 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.352303    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.352488 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.352471    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.352561 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.352496    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.352621 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.352601    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.358925 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.358879    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.359013 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.358992    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d459z\" (UniqueName: \"kubernetes.io/projected/b5a7007c-6cda-42af-9120-cc9a07a0d3e0-kube-api-access-d459z\") pod \"istiod-openshift-gateway-5677ccb49b-vdp9t\" (UID: \"b5a7007c-6cda-42af-9120-cc9a07a0d3e0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.419950 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.419927    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:01.564310 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:01.564261    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"]
Jul 27 18:36:01.567735 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:36:01.567671    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5a7007c_6cda_42af_9120_cc9a07a0d3e0.slice/crio-a6641ad1cea19daf1c05114ee816653b43c68c6d49a83bd91493efa011742c4d WatchSource:0}: Error finding container a6641ad1cea19daf1c05114ee816653b43c68c6d49a83bd91493efa011742c4d: Status 404 returned error can't find the container with id a6641ad1cea19daf1c05114ee816653b43c68c6d49a83bd91493efa011742c4d
Jul 27 18:36:02.000599 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:02.000565    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t" event={"ID":"b5a7007c-6cda-42af-9120-cc9a07a0d3e0","Type":"ContainerStarted","Data":"a6641ad1cea19daf1c05114ee816653b43c68c6d49a83bd91493efa011742c4d"}
Jul 27 18:36:04.487297 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:04.487255    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 18:36:04.487614 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:04.487328    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"}
Jul 27 18:36:05.016066 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:05.016027    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t" event={"ID":"b5a7007c-6cda-42af-9120-cc9a07a0d3e0","Type":"ContainerStarted","Data":"a06eb0976a2883f2840941543d550afea8a40d8f88c6ae852fabb07f680c245c"}
Jul 27 18:36:05.016278 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:05.016248    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:05.017929 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:05.017900    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-vdp9t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:36:05.018055 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:05.017941    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t" podUID="b5a7007c-6cda-42af-9120-cc9a07a0d3e0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:36:05.045118 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:05.045062    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t" podStartSLOduration=1.128241106 podStartE2EDuration="4.045044079s" totalImagesPullingTime="2.916802973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:36:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:36:05.044074732 +0000 UTC m=+431.169929074" watchObservedRunningTime="2026-07-27 18:36:05.045044079 +0000 UTC m=+431.170898422"
Jul 27 18:36:06.021101 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:06.021073    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-vdp9t container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 27 18:36:06.021494 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:06.021119    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t" podUID="b5a7007c-6cda-42af-9120-cc9a07a0d3e0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 27 18:36:06.977850 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:06.977821    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7cc45b746b-jzcn6"
Jul 27 18:36:09.021638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:09.021609    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vdp9t"
Jul 27 18:36:09.996423 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:36:09.996391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vc8p9"
Jul 27 18:38:53.423400 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.423368    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:38:53.426002 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.425983    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.428995 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.428974    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 27 18:38:53.428995 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.428990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-jv8qx\""
Jul 27 18:38:53.429124 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.428994    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 27 18:38:53.430290 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.430274    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 27 18:38:53.435114 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.435092    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:38:53.458937 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.458917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:38:53.475884 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.475856    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg8tx\" (UniqueName: \"kubernetes.io/projected/31bb8858-538d-44fb-a592-a0447aa4f3cd-kube-api-access-xg8tx\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.475973 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.475894    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31bb8858-538d-44fb-a592-a0447aa4f3cd-config-file\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.576908 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.576887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg8tx\" (UniqueName: \"kubernetes.io/projected/31bb8858-538d-44fb-a592-a0447aa4f3cd-kube-api-access-xg8tx\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.577002 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.576921    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31bb8858-538d-44fb-a592-a0447aa4f3cd-config-file\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.577507 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.577491    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/31bb8858-538d-44fb-a592-a0447aa4f3cd-config-file\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.585419 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.585399    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg8tx\" (UniqueName: \"kubernetes.io/projected/31bb8858-538d-44fb-a592-a0447aa4f3cd-kube-api-access-xg8tx\") pod \"limitador-limitador-54d6d988d5-5jdv5\" (UID: \"31bb8858-538d-44fb-a592-a0447aa4f3cd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.736229 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.736206    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:53.869216 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:53.869056    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:38:53.871461 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:38:53.871414    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31bb8858_538d_44fb_a592_a0447aa4f3cd.slice/crio-adb7a35ec1899d6bc83929e5e5b3fb5145f96bb2ea177e516c81a84cdf655b40 WatchSource:0}: Error finding container adb7a35ec1899d6bc83929e5e5b3fb5145f96bb2ea177e516c81a84cdf655b40: Status 404 returned error can't find the container with id adb7a35ec1899d6bc83929e5e5b3fb5145f96bb2ea177e516c81a84cdf655b40
Jul 27 18:38:54.707422 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:54.707375    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5" event={"ID":"31bb8858-538d-44fb-a592-a0447aa4f3cd","Type":"ContainerStarted","Data":"adb7a35ec1899d6bc83929e5e5b3fb5145f96bb2ea177e516c81a84cdf655b40"}
Jul 27 18:38:56.718224 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:56.718189    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5" event={"ID":"31bb8858-538d-44fb-a592-a0447aa4f3cd","Type":"ContainerStarted","Data":"6fc3beecd97101b020b947b0c79a38401713dd530ff6fca1e5ad8bb9d0a1d69c"}
Jul 27 18:38:56.718663 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:56.718468    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:38:56.737143 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:38:56.737094    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5" podStartSLOduration=1.200666054 podStartE2EDuration="3.737080322s" totalImagesPullingTime="2.536414268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:38:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:38:56.735790775 +0000 UTC m=+602.861645133" watchObservedRunningTime="2026-07-27 18:38:56.737080322 +0000 UTC m=+602.862934683"
Jul 27 18:39:07.723433 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:39:07.723405    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"
Jul 27 18:40:08.055544 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:40:08.055510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:40:26.991295 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:40:26.991259    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:40:40.077126 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:40:40.077086    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:41:07.596749 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:07.596717    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:41:19.392132 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.392101    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"]
Jul 27 18:41:19.395279 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.395261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.399887 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.399854    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 27 18:41:19.399887 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.399861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-6w4tt\""
Jul 27 18:41:19.400079 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.399861    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 27 18:41:19.400079 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.399962    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 27 18:41:19.405821 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.405801    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"]
Jul 27 18:41:19.480674 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh864\" (UniqueName: \"kubernetes.io/projected/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-kube-api-access-wh864\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.480833 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480690    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.480833 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480731    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.480919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.480919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480912    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.481020 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.480930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582325 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582301    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582325 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582328    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582572 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582351    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh864\" (UniqueName: \"kubernetes.io/projected/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-kube-api-access-wh864\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582572 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582395    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582572 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582422    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582572 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582469    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582714    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582770    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.582869 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.582836    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.584731 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.584709    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.584935 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.584917    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.591528 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.591508    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh864\" (UniqueName: \"kubernetes.io/projected/5bb96ade-d3c4-44bf-87a0-bbdd65398d88-kube-api-access-wh864\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk\" (UID: \"5bb96ade-d3c4-44bf-87a0-bbdd65398d88\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.705376 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.705348    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:19.833307 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.833126    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"]
Jul 27 18:41:19.836027 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:41:19.835990    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb96ade_d3c4_44bf_87a0_bbdd65398d88.slice/crio-5154f7007cec3e44a647d9a1da0c08fdb1d03aac379384d6b0b23cbd7293268c WatchSource:0}: Error finding container 5154f7007cec3e44a647d9a1da0c08fdb1d03aac379384d6b0b23cbd7293268c: Status 404 returned error can't find the container with id 5154f7007cec3e44a647d9a1da0c08fdb1d03aac379384d6b0b23cbd7293268c
Jul 27 18:41:19.837185 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:19.837169    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:41:20.315301 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:20.315266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk" event={"ID":"5bb96ade-d3c4-44bf-87a0-bbdd65398d88","Type":"ContainerStarted","Data":"5154f7007cec3e44a647d9a1da0c08fdb1d03aac379384d6b0b23cbd7293268c"}
Jul 27 18:41:20.981778 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:20.981740    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:41:21.320349 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:21.320316    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk" event={"ID":"5bb96ade-d3c4-44bf-87a0-bbdd65398d88","Type":"ContainerStarted","Data":"0fa5f089f490b82682e063ce812cfe1b0a977280f62b57d7f21d349bf295be67"}
Jul 27 18:41:21.369230 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:21.369185    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk" podStartSLOduration=1.404695227 podStartE2EDuration="2.369169308s" totalImagesPullingTime="964.474081ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:41:21.366496728 +0000 UTC m=+747.492351110" watchObservedRunningTime="2026-07-27 18:41:21.369169308 +0000 UTC m=+747.495023628"
Jul 27 18:41:29.705756 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:29.705725    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:29.706174 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:29.705770    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:29.717671 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:29.717646    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:30.376051 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:30.376026    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk"
Jul 27 18:41:45.002554 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:41:45.002521    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:42:00.389797 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:42:00.389767    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:43:19.185880 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:43:19.185845    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:43:30.209960 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:43:30.209928    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:43:40.303982 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:43:40.303949    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:45:22.247753 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:45:22.247676    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:45:33.497927 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:45:33.497891    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:46:11.096360 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:46:11.096323    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:46:21.189202 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:46:21.189167    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:46:31.591139 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:46:31.591108    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:46:39.685720 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:46:39.685687    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:46:50.303845 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:46:50.303773    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:47:00.001837 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:47:00.001808    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:47:12.297618 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:47:12.297578    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:47:21.902953 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:47:21.902922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:47:44.197331 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:47:44.197299    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:47:55.895594 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:47:55.895562    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:48:20.624118 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:48:20.624045    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:48:38.302535 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:48:38.302501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:48:49.307638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:48:49.307610    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:49:08.596541 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:49:08.596501    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:49:19.703057 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:49:19.703004    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:49:29.708106 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:49:29.708074    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:51:16.814025 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:51:16.813945    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:51:26.205998 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:51:26.205958    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:51:40.500515 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:51:40.500480    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:51:53.605359 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:51:53.605323    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:03.896131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:03.896098    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:14.993987 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:14.993954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:22.897013 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:22.896975    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:33.800300 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:33.800268    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:45.600142 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:45.600068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:52:54.800974 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:52:54.800936    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:53:05.595739 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:53:05.595701    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:53:26.796083 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:53:26.796048    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:53:36.697255 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:53:36.697219    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:53:50.292806 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:53:50.292770    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:54:06.788787 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:54:06.788755    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:54:33.998722 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:54:33.998641    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:54:49.393596 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:54:49.393561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:54:58.701457 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:54:58.701417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:10.498249 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:10.498216    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:20.003456 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:20.003417    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:29.499691 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:29.499647    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:39.678859 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:39.678827    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:48.799793 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:48.799708    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:55:58.104556 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:55:58.104526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:56:12.510538 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:56:12.510505    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:56:21.628539 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:56:21.628510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:56:31.301585 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:56:31.301552    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:56:43.303901 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:56:43.303871    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:56:54.397339 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:56:54.397305    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:57:03.301757 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:57:03.301728    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:57:15.810188 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:57:15.810120    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:57:27.446782 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:57:27.446743    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:57:36.995054 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:57:36.995023    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:57:51.598084 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:57:51.598045    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:58:00.890931 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:00.890896    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:58:10.830906 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:10.830869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:58:22.287854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:22.287818    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:58:40.250668 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.250637    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"]
Jul 27 18:58:40.253854 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.253838    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:40.256756 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.256736    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 18:58:40.257030 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.257016    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:58:40.263141 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.263122    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"]
Jul 27 18:58:40.339987 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.339957    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk\" (UID: \"49790dfc-feb1-41c8-b370-d36d120d5ffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:40.441199 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.441181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk\" (UID: \"49790dfc-feb1-41c8-b370-d36d120d5ffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:40.441846 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.441827    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk\" (UID: \"49790dfc-feb1-41c8-b370-d36d120d5ffe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:40.564268 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.564213    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:40.690734 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.690700    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"]
Jul 27 18:58:40.692977 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:58:40.692950    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49790dfc_feb1_41c8_b370_d36d120d5ffe.slice/crio-704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a WatchSource:0}: Error finding container 704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a: Status 404 returned error can't find the container with id 704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a
Jul 27 18:58:40.694753 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:40.694735    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 18:58:41.453659 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:41.453628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk" event={"ID":"49790dfc-feb1-41c8-b370-d36d120d5ffe","Type":"ContainerStarted","Data":"704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a"}
Jul 27 18:58:43.464268 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:43.464232    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk" event={"ID":"49790dfc-feb1-41c8-b370-d36d120d5ffe","Type":"ContainerStarted","Data":"807987f3710a05fc445760f45df05d2ff322e836e37830aaa4deb5ba34bc4952"}
Jul 27 18:58:43.483083 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:43.483038    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk" podStartSLOduration=1.135305689 podStartE2EDuration="3.483024888s" totalImagesPullingTime="2.347719199s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:58:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:58:43.480792958 +0000 UTC m=+1789.606647310" watchObservedRunningTime="2026-07-27 18:58:43.483024888 +0000 UTC m=+1789.608879229"
Jul 27 18:58:44.469675 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:44.469645    2567 generic.go:356] "Generic (PLEG): container finished" podID="49790dfc-feb1-41c8-b370-d36d120d5ffe" containerID="807987f3710a05fc445760f45df05d2ff322e836e37830aaa4deb5ba34bc4952" exitCode=0
Jul 27 18:58:44.470025 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:44.469678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk" event={"ID":"49790dfc-feb1-41c8-b370-d36d120d5ffe","Type":"ContainerDied","Data":"807987f3710a05fc445760f45df05d2ff322e836e37830aaa4deb5ba34bc4952"}
Jul 27 18:58:45.594611 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:45.594585    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:45.685019 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:45.684991    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca\") pod \"49790dfc-feb1-41c8-b370-d36d120d5ffe\" (UID: \"49790dfc-feb1-41c8-b370-d36d120d5ffe\") "
Jul 27 18:58:45.685340 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:45.685317    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "49790dfc-feb1-41c8-b370-d36d120d5ffe" (UID: "49790dfc-feb1-41c8-b370-d36d120d5ffe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:58:45.785992 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:45.785941    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/49790dfc-feb1-41c8-b370-d36d120d5ffe-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:58:46.478259 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:46.478238    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"
Jul 27 18:58:46.478378 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:46.478256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk" event={"ID":"49790dfc-feb1-41c8-b370-d36d120d5ffe","Type":"ContainerDied","Data":"704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a"}
Jul 27 18:58:46.478378 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:46.478292    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="704ccc4cf1e5b722c9b47947b0c189a926e4650af819a5dc1d49d30c727d5f4a"
Jul 27 18:58:53.889820 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:53.889785    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:58:55.332086 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:55.332050    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"]
Jul 27 18:58:55.335491 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:55.335467    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-001f5ecd-5bhbk"]
Jul 27 18:58:56.381989 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:56.381954    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49790dfc-feb1-41c8-b370-d36d120d5ffe" path="/var/lib/kubelet/pods/49790dfc-feb1-41c8-b370-d36d120d5ffe/volumes"
Jul 27 18:58:59.666763 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.666734    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:58:59.667166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.667046    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49790dfc-feb1-41c8-b370-d36d120d5ffe" containerName="revoke-keys"
Jul 27 18:58:59.667166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.667058    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="49790dfc-feb1-41c8-b370-d36d120d5ffe" containerName="revoke-keys"
Jul 27 18:58:59.667166 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.667113    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="49790dfc-feb1-41c8-b370-d36d120d5ffe" containerName="revoke-keys"
Jul 27 18:58:59.673049 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.673032    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.676500 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.676476    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-09eed4cd\""
Jul 27 18:58:59.687949 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.687920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:58:59.708120 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.708097    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:58:59.711672 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.711655    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.714305 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.714288    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-09eed4cd-dockercfg-8sktz\""
Jul 27 18:58:59.722393 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.722370    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:58:59.796375 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.796348    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqts6\" (UniqueName: \"kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.796515 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.796401    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.796559 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.796523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.796597 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.796570    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gpql\" (UniqueName: \"kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.897482 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.897425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.897613 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.897535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.897613 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.897577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gpql\" (UniqueName: \"kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.897720 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.897678    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqts6\" (UniqueName: \"kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.898195 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.898177    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.898295 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.898278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.910346 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.910318    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gpql\" (UniqueName: \"kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql\") pod \"payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") " pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:58:59.910425 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.910394    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqts6\" (UniqueName: \"kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6\") pod \"payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:58:59.983260 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:58:59.983236    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:59:00.020818 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:00.020791    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:59:00.129372 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:00.129347    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:59:00.132318 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:59:00.132282    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86eb4ea2_a06c_43ef_b40f_354cd6d00492.slice/crio-2a85ff4a8507e5d966b4a022cbd87c460e85c0590ccc682f13ca91d444e035a6 WatchSource:0}: Error finding container 2a85ff4a8507e5d966b4a022cbd87c460e85c0590ccc682f13ca91d444e035a6: Status 404 returned error can't find the container with id 2a85ff4a8507e5d966b4a022cbd87c460e85c0590ccc682f13ca91d444e035a6
Jul 27 18:59:00.169241 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:00.169220    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:59:00.170952 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:59:00.170928    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68299e6d_cc84_4db1_8b7c_fbc7fa62755c.slice/crio-81d641c6a32a2a30e1d62c2413456414733aa038815ef47168ebb232a1fbfce2 WatchSource:0}: Error finding container 81d641c6a32a2a30e1d62c2413456414733aa038815ef47168ebb232a1fbfce2: Status 404 returned error can't find the container with id 81d641c6a32a2a30e1d62c2413456414733aa038815ef47168ebb232a1fbfce2
Jul 27 18:59:00.540677 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:00.540647    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" event={"ID":"86eb4ea2-a06c-43ef-b40f-354cd6d00492","Type":"ContainerStarted","Data":"2a85ff4a8507e5d966b4a022cbd87c460e85c0590ccc682f13ca91d444e035a6"}
Jul 27 18:59:00.541760 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:00.541738    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" event={"ID":"68299e6d-cc84-4db1-8b7c-fbc7fa62755c","Type":"ContainerStarted","Data":"81d641c6a32a2a30e1d62c2413456414733aa038815ef47168ebb232a1fbfce2"}
Jul 27 18:59:02.553228 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.553187    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" event={"ID":"68299e6d-cc84-4db1-8b7c-fbc7fa62755c","Type":"ContainerStarted","Data":"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"}
Jul 27 18:59:02.553705 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.553247    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:59:02.554574 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.554551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" event={"ID":"86eb4ea2-a06c-43ef-b40f-354cd6d00492","Type":"ContainerStarted","Data":"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"}
Jul 27 18:59:02.554690 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.554673    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:59:02.572479 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.572419    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" podStartSLOduration=1.809948693 podStartE2EDuration="3.572404847s" totalImagesPullingTime="1.762456154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:59:02.570886202 +0000 UTC m=+1808.696740545" watchObservedRunningTime="2026-07-27 18:59:02.572404847 +0000 UTC m=+1808.698259166"
Jul 27 18:59:02.587948 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:02.587896    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" podStartSLOduration=1.793263826 podStartE2EDuration="3.587883742s" totalImagesPullingTime="1.794619916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:58:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:59:02.587605424 +0000 UTC m=+1808.713459768" watchObservedRunningTime="2026-07-27 18:59:02.587883742 +0000 UTC m=+1808.713738109"
Jul 27 18:59:05.810893 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:05.810860    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:59:13.561825 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:13.561799    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:59:13.562262 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:13.561860    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:59:24.015226 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.015194    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"]
Jul 27 18:59:24.018750 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.018734    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:24.022646 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.022625    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 18:59:24.023021 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.023008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 18:59:24.032461 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.032418    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"]
Jul 27 18:59:24.175450 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.175407    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm\" (UID: \"b1f5620c-c021-4698-a8b7-fbbc46f209d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:24.275985 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.275932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm\" (UID: \"b1f5620c-c021-4698-a8b7-fbbc46f209d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:24.276499 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.276480    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm\" (UID: \"b1f5620c-c021-4698-a8b7-fbbc46f209d3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:24.329250 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.329230    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:24.480471 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.480386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"]
Jul 27 18:59:24.483145 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:59:24.483120    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1f5620c_c021_4698_a8b7_fbbc46f209d3.slice/crio-c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180 WatchSource:0}: Error finding container c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180: Status 404 returned error can't find the container with id c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180
Jul 27 18:59:24.645674 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:24.645609    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm" event={"ID":"b1f5620c-c021-4698-a8b7-fbbc46f209d3","Type":"ContainerStarted","Data":"c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180"}
Jul 27 18:59:25.651933 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:25.651869    2567 generic.go:356] "Generic (PLEG): container finished" podID="b1f5620c-c021-4698-a8b7-fbbc46f209d3" containerID="4d1b84a2758ce282a494b167329925504db117156b4e44282fc7a0a577fd0ae3" exitCode=0
Jul 27 18:59:25.652238 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:25.651961    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm" event={"ID":"b1f5620c-c021-4698-a8b7-fbbc46f209d3","Type":"ContainerDied","Data":"4d1b84a2758ce282a494b167329925504db117156b4e44282fc7a0a577fd0ae3"}
Jul 27 18:59:26.777678 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:26.777656    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:26.892365 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:26.892341    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca\") pod \"b1f5620c-c021-4698-a8b7-fbbc46f209d3\" (UID: \"b1f5620c-c021-4698-a8b7-fbbc46f209d3\") "
Jul 27 18:59:26.892679 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:26.892658    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b1f5620c-c021-4698-a8b7-fbbc46f209d3" (UID: "b1f5620c-c021-4698-a8b7-fbbc46f209d3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:59:26.993411 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:26.993367    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1f5620c-c021-4698-a8b7-fbbc46f209d3-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:59:27.661718 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:27.661689    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"
Jul 27 18:59:27.661906 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:27.661691    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm" event={"ID":"b1f5620c-c021-4698-a8b7-fbbc46f209d3","Type":"ContainerDied","Data":"c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180"}
Jul 27 18:59:27.661906 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:27.661812    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c47e751fdb49dad708ada41d1cf14cf33795c874756a3d854faa75506453c180"
Jul 27 18:59:34.687510 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.687478    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:59:34.687948 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.687677    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" podUID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" containerName="payload-processing" containerID="cri-o://1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce" gracePeriod=30
Jul 27 18:59:34.701388 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.701359    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:59:34.701734 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.701702    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" podUID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" containerName="payload-pre-processing" containerID="cri-o://bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6" gracePeriod=30
Jul 27 18:59:34.960947 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.960926    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:59:34.982732 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:34.982710    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:59:35.049607 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.049580    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume\") pod \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") "
Jul 27 18:59:35.049729 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.049630    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4gpql\" (UniqueName: \"kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql\") pod \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\" (UID: \"68299e6d-cc84-4db1-8b7c-fbc7fa62755c\") "
Jul 27 18:59:35.049924 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.049904    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68299e6d-cc84-4db1-8b7c-fbc7fa62755c" (UID: "68299e6d-cc84-4db1-8b7c-fbc7fa62755c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:59:35.051991 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.051972    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql" (OuterVolumeSpecName: "kube-api-access-4gpql") pod "68299e6d-cc84-4db1-8b7c-fbc7fa62755c" (UID: "68299e6d-cc84-4db1-8b7c-fbc7fa62755c"). InnerVolumeSpecName "kube-api-access-4gpql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:59:35.150701 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.150682    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqts6\" (UniqueName: \"kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6\") pod \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") "
Jul 27 18:59:35.150821 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.150709    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume\") pod \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\" (UID: \"86eb4ea2-a06c-43ef-b40f-354cd6d00492\") "
Jul 27 18:59:35.150883 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.150821    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:59:35.150883 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.150833    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4gpql\" (UniqueName: \"kubernetes.io/projected/68299e6d-cc84-4db1-8b7c-fbc7fa62755c-kube-api-access-4gpql\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:59:35.151133 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.151110    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "86eb4ea2-a06c-43ef-b40f-354cd6d00492" (UID: "86eb4ea2-a06c-43ef-b40f-354cd6d00492"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 18:59:35.152670 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.152652    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6" (OuterVolumeSpecName: "kube-api-access-lqts6") pod "86eb4ea2-a06c-43ef-b40f-354cd6d00492" (UID: "86eb4ea2-a06c-43ef-b40f-354cd6d00492"). InnerVolumeSpecName "kube-api-access-lqts6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 18:59:35.251434 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.251369    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqts6\" (UniqueName: \"kubernetes.io/projected/86eb4ea2-a06c-43ef-b40f-354cd6d00492-kube-api-access-lqts6\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:59:35.251434 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.251399    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/86eb4ea2-a06c-43ef-b40f-354cd6d00492-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 18:59:35.699512 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.699482    2567 generic.go:356] "Generic (PLEG): container finished" podID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" containerID="bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6" exitCode=0
Jul 27 18:59:35.699919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.699539    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"
Jul 27 18:59:35.699919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.699569    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" event={"ID":"86eb4ea2-a06c-43ef-b40f-354cd6d00492","Type":"ContainerDied","Data":"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"}
Jul 27 18:59:35.699919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.699637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl" event={"ID":"86eb4ea2-a06c-43ef-b40f-354cd6d00492","Type":"ContainerDied","Data":"2a85ff4a8507e5d966b4a022cbd87c460e85c0590ccc682f13ca91d444e035a6"}
Jul 27 18:59:35.699919 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.699669    2567 scope.go:117] "RemoveContainer" containerID="bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"
Jul 27 18:59:35.700995 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.700959    2567 generic.go:356] "Generic (PLEG): container finished" podID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" containerID="1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce" exitCode=0
Jul 27 18:59:35.701063 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.701023    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"
Jul 27 18:59:35.701063 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.701037    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" event={"ID":"68299e6d-cc84-4db1-8b7c-fbc7fa62755c","Type":"ContainerDied","Data":"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"}
Jul 27 18:59:35.701163 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.701067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg" event={"ID":"68299e6d-cc84-4db1-8b7c-fbc7fa62755c","Type":"ContainerDied","Data":"81d641c6a32a2a30e1d62c2413456414733aa038815ef47168ebb232a1fbfce2"}
Jul 27 18:59:35.712597 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.712583    2567 scope.go:117] "RemoveContainer" containerID="bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"
Jul 27 18:59:35.712824 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:59:35.712806    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6\": container with ID starting with bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6 not found: ID does not exist" containerID="bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"
Jul 27 18:59:35.712862 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.712833    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6"} err="failed to get container status \"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6\": rpc error: code = NotFound desc = could not find container \"bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6\": container with ID starting with bcb3842160c10fbe5e08129855f77422434005b1b62365e7473fceef6f8cb8d6 not found: ID does not exist"
Jul 27 18:59:35.712862 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.712849    2567 scope.go:117] "RemoveContainer" containerID="1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"
Jul 27 18:59:35.720254 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.720235    2567 scope.go:117] "RemoveContainer" containerID="1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"
Jul 27 18:59:35.720509 ip-10-0-134-47 kubenswrapper[2567]: E0727 18:59:35.720487    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce\": container with ID starting with 1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce not found: ID does not exist" containerID="1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"
Jul 27 18:59:35.720606 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.720512    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce"} err="failed to get container status \"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce\": rpc error: code = NotFound desc = could not find container \"1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce\": container with ID starting with 1734db4e106a3cc38cfa122bf85de299921ac6d1b06efea3378a8f0e2ad5b6ce not found: ID does not exist"
Jul 27 18:59:35.744412 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.744391    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:59:35.745913 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.745895    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-09eed4cd-6558f489cb-vbnjl"]
Jul 27 18:59:35.758284 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.758267    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:59:35.766566 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:35.766548    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-09eed4cd-64645775fc-hr6fg"]
Jul 27 18:59:36.381544 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:36.381515    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" path="/var/lib/kubelet/pods/68299e6d-cc84-4db1-8b7c-fbc7fa62755c/volumes"
Jul 27 18:59:36.381915 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:36.381895    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" path="/var/lib/kubelet/pods/86eb4ea2-a06c-43ef-b40f-354cd6d00492/volumes"
Jul 27 18:59:37.498892 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:37.498862    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:59:39.145011 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:39.144981    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"]
Jul 27 18:59:39.158528 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:39.158505    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-09eed4cd-lt5rm"]
Jul 27 18:59:40.382303 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:40.382269    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1f5620c-c021-4698-a8b7-fbbc46f209d3" path="/var/lib/kubelet/pods/b1f5620c-c021-4698-a8b7-fbbc46f209d3/volumes"
Jul 27 18:59:44.525921 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.525886    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" containerName="payload-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526222    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" containerName="payload-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526239    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1f5620c-c021-4698-a8b7-fbbc46f209d3" containerName="revoke-keys"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526245    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1f5620c-c021-4698-a8b7-fbbc46f209d3" containerName="revoke-keys"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526251    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" containerName="payload-pre-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526258    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" containerName="payload-pre-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526310    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="68299e6d-cc84-4db1-8b7c-fbc7fa62755c" containerName="payload-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526318    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="86eb4ea2-a06c-43ef-b40f-354cd6d00492" containerName="payload-pre-processing"
Jul 27 18:59:44.526336 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.526324    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1f5620c-c021-4698-a8b7-fbbc46f209d3" containerName="revoke-keys"
Jul 27 18:59:44.530631 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.530611    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.534426 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.534404    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-217fd0d6\""
Jul 27 18:59:44.534426 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.534419    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-217fd0d6-dockercfg-qcwkn\""
Jul 27 18:59:44.547636 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.547609    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 18:59:44.611539 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.611513    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 18:59:44.613794 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.613780    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.617638 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.617616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.617717 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.617665    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zbr5\" (UniqueName: \"kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.642469 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.642402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 18:59:44.718747 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.718716    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.718961 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.718759    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zbr5\" (UniqueName: \"kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.718961 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.718784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.718961 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.718806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8x8\" (UniqueName: \"kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.719534 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.719517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.734381 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.734322    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zbr5\" (UniqueName: \"kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5\") pod \"payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.819500 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.819416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.819500 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.819481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8x8\" (UniqueName: \"kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.820082 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.820064    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.830214 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.830189    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8x8\" (UniqueName: \"kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8\") pod \"payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") " pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.841131 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.841111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:44.924065 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.924024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:44.975998 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:44.975940    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 18:59:44.978391 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:59:44.978346    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7496049c_bb65_4d0e_ba20_3cab9121a535.slice/crio-21d01197c16d54806aaecf499eb5279379884596c619c9a04974f944975c7c07 WatchSource:0}: Error finding container 21d01197c16d54806aaecf499eb5279379884596c619c9a04974f944975c7c07: Status 404 returned error can't find the container with id 21d01197c16d54806aaecf499eb5279379884596c619c9a04974f944975c7c07
Jul 27 18:59:45.081042 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.081015    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 18:59:45.082381 ip-10-0-134-47 kubenswrapper[2567]: W0727 18:59:45.082352    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7753548_da11_43ed_9cad_47c326901b1d.slice/crio-a85cb980bd82cbce3624d86c777e4a43959343e83d1a13c69cf3f20e287378d8 WatchSource:0}: Error finding container a85cb980bd82cbce3624d86c777e4a43959343e83d1a13c69cf3f20e287378d8: Status 404 returned error can't find the container with id a85cb980bd82cbce3624d86c777e4a43959343e83d1a13c69cf3f20e287378d8
Jul 27 18:59:45.750256 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.750216    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" event={"ID":"f7753548-da11-43ed-9cad-47c326901b1d","Type":"ContainerStarted","Data":"91ee606d4b7328c9e47af56f8a0c9f2716f6478c273a0005de334f6774f4353b"}
Jul 27 18:59:45.750671 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.750275    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" event={"ID":"f7753548-da11-43ed-9cad-47c326901b1d","Type":"ContainerStarted","Data":"a85cb980bd82cbce3624d86c777e4a43959343e83d1a13c69cf3f20e287378d8"}
Jul 27 18:59:45.750671 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.750302    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:45.751714 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.751695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" event={"ID":"7496049c-bb65-4d0e-ba20-3cab9121a535","Type":"ContainerStarted","Data":"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"}
Jul 27 18:59:45.751764 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.751731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" event={"ID":"7496049c-bb65-4d0e-ba20-3cab9121a535","Type":"ContainerStarted","Data":"21d01197c16d54806aaecf499eb5279379884596c619c9a04974f944975c7c07"}
Jul 27 18:59:45.751836 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.751817    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 18:59:45.772204 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.772162    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" podStartSLOduration=1.772148635 podStartE2EDuration="1.772148635s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:59:45.771009076 +0000 UTC m=+1851.896863418" watchObservedRunningTime="2026-07-27 18:59:45.772148635 +0000 UTC m=+1851.898002971"
Jul 27 18:59:45.802548 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:45.802502    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" podStartSLOduration=1.802490052 podStartE2EDuration="1.802490052s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 18:59:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 18:59:45.802096452 +0000 UTC m=+1851.927950795" watchObservedRunningTime="2026-07-27 18:59:45.802490052 +0000 UTC m=+1851.928344394"
Jul 27 18:59:49.193011 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:49.192970    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 18:59:56.762560 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:56.762530    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 18:59:56.762978 ip-10-0-134-47 kubenswrapper[2567]: I0727 18:59:56.762609    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 19:00:09.073008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.072978    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"]
Jul 27 19:00:09.076315 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.076299    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:09.079638 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.079617    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:00:09.080997 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.080974    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:00:09.092878 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.092856    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"]
Jul 27 19:00:09.117873 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.117847    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d\" (UID: \"f00cafae-60b4-450a-b1a4-bbc9c456709c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:09.218359 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.218330    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d\" (UID: \"f00cafae-60b4-450a-b1a4-bbc9c456709c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:09.218896 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.218877    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d\" (UID: \"f00cafae-60b4-450a-b1a4-bbc9c456709c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:09.385614 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.385562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:09.513513 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.513487    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"]
Jul 27 19:00:09.516058 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:00:09.516030    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00cafae_60b4_450a_b1a4_bbc9c456709c.slice/crio-3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c WatchSource:0}: Error finding container 3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c: Status 404 returned error can't find the container with id 3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c
Jul 27 19:00:09.863018 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.862984    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d" event={"ID":"f00cafae-60b4-450a-b1a4-bbc9c456709c","Type":"ContainerStarted","Data":"25619c7760dd0df83449ee9ead848fb9a4b81671be63cc985a44120be3a3b0d6"}
Jul 27 19:00:09.863117 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:09.863044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d" event={"ID":"f00cafae-60b4-450a-b1a4-bbc9c456709c","Type":"ContainerStarted","Data":"3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c"}
Jul 27 19:00:10.868275 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:10.868237    2567 generic.go:356] "Generic (PLEG): container finished" podID="f00cafae-60b4-450a-b1a4-bbc9c456709c" containerID="25619c7760dd0df83449ee9ead848fb9a4b81671be63cc985a44120be3a3b0d6" exitCode=0
Jul 27 19:00:10.868660 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:10.868327    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d" event={"ID":"f00cafae-60b4-450a-b1a4-bbc9c456709c","Type":"ContainerDied","Data":"25619c7760dd0df83449ee9ead848fb9a4b81671be63cc985a44120be3a3b0d6"}
Jul 27 19:00:11.997229 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:11.997208    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:12.040424 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.040399    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca\") pod \"f00cafae-60b4-450a-b1a4-bbc9c456709c\" (UID: \"f00cafae-60b4-450a-b1a4-bbc9c456709c\") "
Jul 27 19:00:12.040697 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.040673    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f00cafae-60b4-450a-b1a4-bbc9c456709c" (UID: "f00cafae-60b4-450a-b1a4-bbc9c456709c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:12.141426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.141367    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f00cafae-60b4-450a-b1a4-bbc9c456709c-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:12.877831 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.877806    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"
Jul 27 19:00:12.877972 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.877802    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d" event={"ID":"f00cafae-60b4-450a-b1a4-bbc9c456709c","Type":"ContainerDied","Data":"3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c"}
Jul 27 19:00:12.877972 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:12.877929    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3ee147bb9a80c6e009bda0d5eac143ba430b4a39ccd3aaa6226e93ae4ddad13c"
Jul 27 19:00:19.643741 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.643651    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 19:00:19.644408 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.643920    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" podUID="f7753548-da11-43ed-9cad-47c326901b1d" containerName="payload-processing" containerID="cri-o://91ee606d4b7328c9e47af56f8a0c9f2716f6478c273a0005de334f6774f4353b" gracePeriod=30
Jul 27 19:00:19.646959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.646932    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 19:00:19.647199 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.647154    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" podUID="7496049c-bb65-4d0e-ba20-3cab9121a535" containerName="payload-pre-processing" containerID="cri-o://f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23" gracePeriod=30
Jul 27 19:00:19.892546 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.892522    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 19:00:19.910575 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.910530    2567 generic.go:356] "Generic (PLEG): container finished" podID="7496049c-bb65-4d0e-ba20-3cab9121a535" containerID="f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23" exitCode=0
Jul 27 19:00:19.910717 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.910609    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"
Jul 27 19:00:19.910717 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.910646    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" event={"ID":"7496049c-bb65-4d0e-ba20-3cab9121a535","Type":"ContainerDied","Data":"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"}
Jul 27 19:00:19.910863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.910716    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8" event={"ID":"7496049c-bb65-4d0e-ba20-3cab9121a535","Type":"ContainerDied","Data":"21d01197c16d54806aaecf499eb5279379884596c619c9a04974f944975c7c07"}
Jul 27 19:00:19.910863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.910745    2567 scope.go:117] "RemoveContainer" containerID="f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"
Jul 27 19:00:19.913116 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.913082    2567 generic.go:356] "Generic (PLEG): container finished" podID="f7753548-da11-43ed-9cad-47c326901b1d" containerID="91ee606d4b7328c9e47af56f8a0c9f2716f6478c273a0005de334f6774f4353b" exitCode=0
Jul 27 19:00:19.913227 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.913127    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" event={"ID":"f7753548-da11-43ed-9cad-47c326901b1d","Type":"ContainerDied","Data":"91ee606d4b7328c9e47af56f8a0c9f2716f6478c273a0005de334f6774f4353b"}
Jul 27 19:00:19.923058 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.923041    2567 scope.go:117] "RemoveContainer" containerID="f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"
Jul 27 19:00:19.923336 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:00:19.923317    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23\": container with ID starting with f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23 not found: ID does not exist" containerID="f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"
Jul 27 19:00:19.923401 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.923345    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23"} err="failed to get container status \"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23\": rpc error: code = NotFound desc = could not find container \"f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23\": container with ID starting with f356cb3836015c93f426add2fe9634a50f6c0c2e0068d41a46edd1912de07c23 not found: ID does not exist"
Jul 27 19:00:19.923934 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:19.923920    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 19:00:20.001675 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.001645    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf8x8\" (UniqueName: \"kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8\") pod \"f7753548-da11-43ed-9cad-47c326901b1d\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") "
Jul 27 19:00:20.001813 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.001736    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume\") pod \"f7753548-da11-43ed-9cad-47c326901b1d\" (UID: \"f7753548-da11-43ed-9cad-47c326901b1d\") "
Jul 27 19:00:20.001813 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.001767    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zbr5\" (UniqueName: \"kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5\") pod \"7496049c-bb65-4d0e-ba20-3cab9121a535\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") "
Jul 27 19:00:20.001813 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.001798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume\") pod \"7496049c-bb65-4d0e-ba20-3cab9121a535\" (UID: \"7496049c-bb65-4d0e-ba20-3cab9121a535\") "
Jul 27 19:00:20.002206 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.002178    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f7753548-da11-43ed-9cad-47c326901b1d" (UID: "f7753548-da11-43ed-9cad-47c326901b1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:20.002206 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.002182    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7496049c-bb65-4d0e-ba20-3cab9121a535" (UID: "7496049c-bb65-4d0e-ba20-3cab9121a535"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:20.003873 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.003845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8" (OuterVolumeSpecName: "kube-api-access-kf8x8") pod "f7753548-da11-43ed-9cad-47c326901b1d" (UID: "f7753548-da11-43ed-9cad-47c326901b1d"). InnerVolumeSpecName "kube-api-access-kf8x8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:20.003954 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.003926    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5" (OuterVolumeSpecName: "kube-api-access-8zbr5") pod "7496049c-bb65-4d0e-ba20-3cab9121a535" (UID: "7496049c-bb65-4d0e-ba20-3cab9121a535"). InnerVolumeSpecName "kube-api-access-8zbr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:00:20.102953 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.102931    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf8x8\" (UniqueName: \"kubernetes.io/projected/f7753548-da11-43ed-9cad-47c326901b1d-kube-api-access-kf8x8\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:20.102953 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.102951    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f7753548-da11-43ed-9cad-47c326901b1d-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:20.103073 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.102960    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zbr5\" (UniqueName: \"kubernetes.io/projected/7496049c-bb65-4d0e-ba20-3cab9121a535-kube-api-access-8zbr5\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:20.103073 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.102968    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7496049c-bb65-4d0e-ba20-3cab9121a535-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:20.232778 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.232750    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 19:00:20.236649 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.236629    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-217fd0d6-7b49f9f57b-ntjq8"]
Jul 27 19:00:20.381520 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.381500    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7496049c-bb65-4d0e-ba20-3cab9121a535" path="/var/lib/kubelet/pods/7496049c-bb65-4d0e-ba20-3cab9121a535/volumes"
Jul 27 19:00:20.918752 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.918695    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"
Jul 27 19:00:20.918752 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.918697    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5" event={"ID":"f7753548-da11-43ed-9cad-47c326901b1d","Type":"ContainerDied","Data":"a85cb980bd82cbce3624d86c777e4a43959343e83d1a13c69cf3f20e287378d8"}
Jul 27 19:00:20.918752 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.918748    2567 scope.go:117] "RemoveContainer" containerID="91ee606d4b7328c9e47af56f8a0c9f2716f6478c273a0005de334f6774f4353b"
Jul 27 19:00:20.936247 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.936222    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 19:00:20.937742 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:20.937724    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-217fd0d6-6cb597988-frpd5"]
Jul 27 19:00:22.381249 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:22.381221    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f7753548-da11-43ed-9cad-47c326901b1d" path="/var/lib/kubelet/pods/f7753548-da11-43ed-9cad-47c326901b1d/volumes"
Jul 27 19:00:23.176950 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:23.176920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:00:24.134917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:24.134890    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"]
Jul 27 19:00:24.137362 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:24.137338    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-217fd0d6-pmg7d"]
Jul 27 19:00:24.381281 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:24.381254    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f00cafae-60b4-450a-b1a4-bbc9c456709c" path="/var/lib/kubelet/pods/f00cafae-60b4-450a-b1a4-bbc9c456709c/volumes"
Jul 27 19:00:29.171546 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171512    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171862    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7496049c-bb65-4d0e-ba20-3cab9121a535" containerName="payload-pre-processing"
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171874    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7496049c-bb65-4d0e-ba20-3cab9121a535" containerName="payload-pre-processing"
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171886    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7753548-da11-43ed-9cad-47c326901b1d" containerName="payload-processing"
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171891    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7753548-da11-43ed-9cad-47c326901b1d" containerName="payload-processing"
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171897    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f00cafae-60b4-450a-b1a4-bbc9c456709c" containerName="revoke-keys"
Jul 27 19:00:29.171917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171904    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f00cafae-60b4-450a-b1a4-bbc9c456709c" containerName="revoke-keys"
Jul 27 19:00:29.172204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171968    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7496049c-bb65-4d0e-ba20-3cab9121a535" containerName="payload-pre-processing"
Jul 27 19:00:29.172204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171978    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f00cafae-60b4-450a-b1a4-bbc9c456709c" containerName="revoke-keys"
Jul 27 19:00:29.172204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.171984    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7753548-da11-43ed-9cad-47c326901b1d" containerName="payload-processing"
Jul 27 19:00:29.174911 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.174894    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.177826 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.177802    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d042bdca-dockercfg-lqklg\""
Jul 27 19:00:29.178066 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.178052    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d042bdca\""
Jul 27 19:00:29.187027 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.187003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:00:29.207649 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.207627    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:00:29.210614 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.210596    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.222567 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.222544    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:00:29.270519 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.270491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq7bm\" (UniqueName: \"kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.270677 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.270526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.270677 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.270560    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.270677 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.270662    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6vzd\" (UniqueName: \"kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.371949 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.371919    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq7bm\" (UniqueName: \"kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.372110 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.371956    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.372110 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.371981    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.372110 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.372012    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6vzd\" (UniqueName: \"kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.372667 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.372646    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.372742 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.372724    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.380673 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.380650    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6vzd\" (UniqueName: \"kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd\") pod \"payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.381516 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.381494    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq7bm\" (UniqueName: \"kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm\") pod \"payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") " pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.484699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.484668    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.520616 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.520586    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.646720 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.646691    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:00:29.647533 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:00:29.647505    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53d357d4_8072_414f_928d_983df93b4879.slice/crio-cb675be44faa21d944f6c941e7aace7248c7033af6d004dfce388f70422d994e WatchSource:0}: Error finding container cb675be44faa21d944f6c941e7aace7248c7033af6d004dfce388f70422d994e: Status 404 returned error can't find the container with id cb675be44faa21d944f6c941e7aace7248c7033af6d004dfce388f70422d994e
Jul 27 19:00:29.868722 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.868698    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:00:29.871045 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:00:29.871014    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1dec3b6_bcd1_46d0_84d4_f39415a5ffb8.slice/crio-e9b2c71eabe2eae0a473eae9ae8f6b0b5a340a9474b9f26c4d12de2b08851811 WatchSource:0}: Error finding container e9b2c71eabe2eae0a473eae9ae8f6b0b5a340a9474b9f26c4d12de2b08851811: Status 404 returned error can't find the container with id e9b2c71eabe2eae0a473eae9ae8f6b0b5a340a9474b9f26c4d12de2b08851811
Jul 27 19:00:29.966659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.966620    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" event={"ID":"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8","Type":"ContainerStarted","Data":"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"}
Jul 27 19:00:29.966812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.966688    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:29.966812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.966717    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" event={"ID":"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8","Type":"ContainerStarted","Data":"e9b2c71eabe2eae0a473eae9ae8f6b0b5a340a9474b9f26c4d12de2b08851811"}
Jul 27 19:00:29.968084 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.968055    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" event={"ID":"53d357d4-8072-414f-928d-983df93b4879","Type":"ContainerStarted","Data":"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"}
Jul 27 19:00:29.968196 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.968107    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" event={"ID":"53d357d4-8072-414f-928d-983df93b4879","Type":"ContainerStarted","Data":"cb675be44faa21d944f6c941e7aace7248c7033af6d004dfce388f70422d994e"}
Jul 27 19:00:29.968196 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.968153    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:29.985832 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:29.985755    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" podStartSLOduration=0.985737318 podStartE2EDuration="985.737318ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:29.984198352 +0000 UTC m=+1896.110052696" watchObservedRunningTime="2026-07-27 19:00:29.985737318 +0000 UTC m=+1896.111591666"
Jul 27 19:00:30.002408 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:30.002366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" podStartSLOduration=1.002352348 podStartE2EDuration="1.002352348s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:30.00088775 +0000 UTC m=+1896.126742091" watchObservedRunningTime="2026-07-27 19:00:30.002352348 +0000 UTC m=+1896.128206689"
Jul 27 19:00:34.084567 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:34.084529    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:00:40.977253 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:40.977225    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:00:40.977678 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:40.977311    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:00:53.165269 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.165231    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"]
Jul 27 19:00:53.169490 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.169461    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:53.172432 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.172405    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:00:53.172698 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.172683    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:00:53.177488 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.177088    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"]
Jul 27 19:00:53.288090 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.288052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d042bdca-b99wb\" (UID: \"a2f3fbf3-a022-4abc-b976-12a784792173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:53.389327 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.389280    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d042bdca-b99wb\" (UID: \"a2f3fbf3-a022-4abc-b976-12a784792173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:53.389944 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.389920    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d042bdca-b99wb\" (UID: \"a2f3fbf3-a022-4abc-b976-12a784792173\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:53.480723 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.480691    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:53.610641 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:53.610618    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"]
Jul 27 19:00:53.612768 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:00:53.612732    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f3fbf3_a022_4abc_b976_12a784792173.slice/crio-edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b WatchSource:0}: Error finding container edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b: Status 404 returned error can't find the container with id edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b
Jul 27 19:00:54.092696 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:54.092606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb" event={"ID":"a2f3fbf3-a022-4abc-b976-12a784792173","Type":"ContainerStarted","Data":"221fcab9211523aaf56a00ed22eca87c7c74f0828e62f935260d64e1fb1845c4"}
Jul 27 19:00:54.092696 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:54.092660    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb" event={"ID":"a2f3fbf3-a022-4abc-b976-12a784792173","Type":"ContainerStarted","Data":"edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b"}
Jul 27 19:00:54.108388 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:54.108344    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb" podStartSLOduration=1.108329447 podStartE2EDuration="1.108329447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:00:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:00:54.107258685 +0000 UTC m=+1920.233113027" watchObservedRunningTime="2026-07-27 19:00:54.108329447 +0000 UTC m=+1920.234183788"
Jul 27 19:00:55.097992 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:55.097958    2567 generic.go:356] "Generic (PLEG): container finished" podID="a2f3fbf3-a022-4abc-b976-12a784792173" containerID="221fcab9211523aaf56a00ed22eca87c7c74f0828e62f935260d64e1fb1845c4" exitCode=0
Jul 27 19:00:55.098421 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:55.098044    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb" event={"ID":"a2f3fbf3-a022-4abc-b976-12a784792173","Type":"ContainerDied","Data":"221fcab9211523aaf56a00ed22eca87c7c74f0828e62f935260d64e1fb1845c4"}
Jul 27 19:00:56.242379 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:56.242356    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:56.313203 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:56.313174    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca\") pod \"a2f3fbf3-a022-4abc-b976-12a784792173\" (UID: \"a2f3fbf3-a022-4abc-b976-12a784792173\") "
Jul 27 19:00:56.313552 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:56.313532    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a2f3fbf3-a022-4abc-b976-12a784792173" (UID: "a2f3fbf3-a022-4abc-b976-12a784792173"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:00:56.414427 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:56.414402    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2f3fbf3-a022-4abc-b976-12a784792173-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:00:57.108485 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:57.108432    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"
Jul 27 19:00:57.108671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:57.108458    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb" event={"ID":"a2f3fbf3-a022-4abc-b976-12a784792173","Type":"ContainerDied","Data":"edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b"}
Jul 27 19:00:57.108671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:00:57.108575    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="edb6583096f7716fb3c255d8d14d662f4ee60a1122e96848122f6e1356e4d52b"
Jul 27 19:01:03.747134 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:03.747099    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:01:03.747539 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:03.747362    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" podUID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" containerName="payload-processing" containerID="cri-o://f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16" gracePeriod=30
Jul 27 19:01:03.756329 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:03.756307    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:01:03.756552 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:03.756531    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" podUID="53d357d4-8072-414f-928d-983df93b4879" containerName="payload-pre-processing" containerID="cri-o://ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5" gracePeriod=30
Jul 27 19:01:04.001742 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.001678    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:01:04.033332 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.033307    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:01:04.080630 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.080597    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume\") pod \"53d357d4-8072-414f-928d-983df93b4879\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") "
Jul 27 19:01:04.080812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.080662    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq7bm\" (UniqueName: \"kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm\") pod \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") "
Jul 27 19:01:04.080812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.080708    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6vzd\" (UniqueName: \"kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd\") pod \"53d357d4-8072-414f-928d-983df93b4879\" (UID: \"53d357d4-8072-414f-928d-983df93b4879\") "
Jul 27 19:01:04.080812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.080738    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume\") pod \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\" (UID: \"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8\") "
Jul 27 19:01:04.081102 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.081064    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "53d357d4-8072-414f-928d-983df93b4879" (UID: "53d357d4-8072-414f-928d-983df93b4879"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:04.081239 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.081173    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" (UID: "c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:01:04.082895 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.082875    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm" (OuterVolumeSpecName: "kube-api-access-vq7bm") pod "c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" (UID: "c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8"). InnerVolumeSpecName "kube-api-access-vq7bm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:04.082970 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.082934    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd" (OuterVolumeSpecName: "kube-api-access-j6vzd") pod "53d357d4-8072-414f-928d-983df93b4879" (UID: "53d357d4-8072-414f-928d-983df93b4879"). InnerVolumeSpecName "kube-api-access-j6vzd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:01:04.142258 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.142223    2567 generic.go:356] "Generic (PLEG): container finished" podID="53d357d4-8072-414f-928d-983df93b4879" containerID="ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5" exitCode=0
Jul 27 19:01:04.142426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.142269    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"
Jul 27 19:01:04.142426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.142311    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" event={"ID":"53d357d4-8072-414f-928d-983df93b4879","Type":"ContainerDied","Data":"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"}
Jul 27 19:01:04.142426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.142387    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t" event={"ID":"53d357d4-8072-414f-928d-983df93b4879","Type":"ContainerDied","Data":"cb675be44faa21d944f6c941e7aace7248c7033af6d004dfce388f70422d994e"}
Jul 27 19:01:04.142426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.142419    2567 scope.go:117] "RemoveContainer" containerID="ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"
Jul 27 19:01:04.143676 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.143654    2567 generic.go:356] "Generic (PLEG): container finished" podID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" containerID="f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16" exitCode=0
Jul 27 19:01:04.143757 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.143693    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"
Jul 27 19:01:04.143757 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.143703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" event={"ID":"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8","Type":"ContainerDied","Data":"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"}
Jul 27 19:01:04.143757 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.143742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k" event={"ID":"c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8","Type":"ContainerDied","Data":"e9b2c71eabe2eae0a473eae9ae8f6b0b5a340a9474b9f26c4d12de2b08851811"}
Jul 27 19:01:04.151386 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.151347    2567 scope.go:117] "RemoveContainer" containerID="ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"
Jul 27 19:01:04.151670 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:01:04.151649    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5\": container with ID starting with ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5 not found: ID does not exist" containerID="ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"
Jul 27 19:01:04.151763 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.151675    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5"} err="failed to get container status \"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5\": rpc error: code = NotFound desc = could not find container \"ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5\": container with ID starting with ef226503d5835b631cb285479e8135d0e5267d02e85392c82d9c8614326b31b5 not found: ID does not exist"
Jul 27 19:01:04.151763 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.151692    2567 scope.go:117] "RemoveContainer" containerID="f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"
Jul 27 19:01:04.159274 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.159258    2567 scope.go:117] "RemoveContainer" containerID="f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"
Jul 27 19:01:04.159522 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:01:04.159505    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16\": container with ID starting with f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16 not found: ID does not exist" containerID="f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"
Jul 27 19:01:04.159590 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.159528    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16"} err="failed to get container status \"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16\": rpc error: code = NotFound desc = could not find container \"f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16\": container with ID starting with f98533aec1e88f970c07bc33bfb054c90c66ce63d96b397b718f091c17e18b16 not found: ID does not exist"
Jul 27 19:01:04.166510 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.166489    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:01:04.170250 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.170230    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-d042bdca-95fb58dbb-fpz9k"]
Jul 27 19:01:04.179714 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.179671    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:01:04.181699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.181599    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6vzd\" (UniqueName: \"kubernetes.io/projected/53d357d4-8072-414f-928d-983df93b4879-kube-api-access-j6vzd\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:01:04.181699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.181628    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:01:04.181699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.181644    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/53d357d4-8072-414f-928d-983df93b4879-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:01:04.181699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.181656    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq7bm\" (UniqueName: \"kubernetes.io/projected/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8-kube-api-access-vq7bm\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:01:04.183813 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.183792    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d042bdca-6788d58f48-z7b7t"]
Jul 27 19:01:04.382102 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.382021    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53d357d4-8072-414f-928d-983df93b4879" path="/var/lib/kubelet/pods/53d357d4-8072-414f-928d-983df93b4879/volumes"
Jul 27 19:01:04.382428 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:04.382413    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" path="/var/lib/kubelet/pods/c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8/volumes"
Jul 27 19:01:06.679642 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:06.679608    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:01:08.254503 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:08.254469    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"]
Jul 27 19:01:08.257542 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:08.257514    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d042bdca-b99wb"]
Jul 27 19:01:08.384297 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:01:08.384258    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2f3fbf3-a022-4abc-b976-12a784792173" path="/var/lib/kubelet/pods/a2f3fbf3-a022-4abc-b976-12a784792173/volumes"
Jul 27 19:02:35.487935 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:35.487902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:02:47.690581 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:47.690546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:02:52.528647 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.528612    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:02:52.529100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529043    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2f3fbf3-a022-4abc-b976-12a784792173" containerName="revoke-keys"
Jul 27 19:02:52.529100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529061    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2f3fbf3-a022-4abc-b976-12a784792173" containerName="revoke-keys"
Jul 27 19:02:52.529100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529088    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53d357d4-8072-414f-928d-983df93b4879" containerName="payload-pre-processing"
Jul 27 19:02:52.529100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529098    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="53d357d4-8072-414f-928d-983df93b4879" containerName="payload-pre-processing"
Jul 27 19:02:52.529336 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529117    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" containerName="payload-processing"
Jul 27 19:02:52.529336 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529126    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" containerName="payload-processing"
Jul 27 19:02:52.529336 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529197    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="53d357d4-8072-414f-928d-983df93b4879" containerName="payload-pre-processing"
Jul 27 19:02:52.529336 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529210    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1dec3b6-bcd1-46d0-84d4-f39415a5ffb8" containerName="payload-processing"
Jul 27 19:02:52.529336 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.529220    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2f3fbf3-a022-4abc-b976-12a784792173" containerName="revoke-keys"
Jul 27 19:02:52.532308 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.532288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.534846 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.534820    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:02:52.535452 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.535409    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-9aed4c03\""
Jul 27 19:02:52.535555 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.535410    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-9aed4c03-dockercfg-lht52\""
Jul 27 19:02:52.537916 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.537896    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.544798 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.544775    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:02:52.547510 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.547491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:02:52.567994 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.567960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnh8h\" (UniqueName: \"kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.568103 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.568089    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vd4n2\" (UniqueName: \"kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.568170 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.568141    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.568234 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.568204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.668802 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.668767    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vd4n2\" (UniqueName: \"kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.668946 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.668808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.668946 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.668849    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.668946 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.668886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnh8h\" (UniqueName: \"kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.669536 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.669517    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.669605 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.669555    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.677960 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.677941    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vd4n2\" (UniqueName: \"kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2\") pod \"payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") " pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.678073 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.678058    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnh8h\" (UniqueName: \"kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h\") pod \"payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.842485 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.842427    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:52.853408 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.853389    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:52.988784 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:52.988758    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:02:52.991236 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:02:52.991209    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3354ea0_78e7_4f5a_9b80_d3df1d2f453d.slice/crio-135c477a4fc4a249a02e26d1f50a5e0e2ca86a0cfe165268796387cc96f0317d WatchSource:0}: Error finding container 135c477a4fc4a249a02e26d1f50a5e0e2ca86a0cfe165268796387cc96f0317d: Status 404 returned error can't find the container with id 135c477a4fc4a249a02e26d1f50a5e0e2ca86a0cfe165268796387cc96f0317d
Jul 27 19:02:53.008678 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.008655    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:02:53.010349 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:02:53.010324    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c95b3ae_290f_45df_96b2_d64d9e65855e.slice/crio-f61e835baf1e36d2dbcc693bf63a81dfda08d4283bc54e72224ab5a90d228c53 WatchSource:0}: Error finding container f61e835baf1e36d2dbcc693bf63a81dfda08d4283bc54e72224ab5a90d228c53: Status 404 returned error can't find the container with id f61e835baf1e36d2dbcc693bf63a81dfda08d4283bc54e72224ab5a90d228c53
Jul 27 19:02:53.607010 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.606974    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" event={"ID":"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d","Type":"ContainerStarted","Data":"a17d71307f9f77a6eb469ab796904e792118cdae1aba9b7dd515843c5c6dd035"}
Jul 27 19:02:53.607474 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.607044    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:02:53.607474 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.607072    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" event={"ID":"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d","Type":"ContainerStarted","Data":"135c477a4fc4a249a02e26d1f50a5e0e2ca86a0cfe165268796387cc96f0317d"}
Jul 27 19:02:53.608649 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.608626    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" event={"ID":"7c95b3ae-290f-45df-96b2-d64d9e65855e","Type":"ContainerStarted","Data":"7324f9de16a9e6708702d46b2531a335929fcd0e8c8a8655357ca12f72fb3c4b"}
Jul 27 19:02:53.608750 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.608671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" event={"ID":"7c95b3ae-290f-45df-96b2-d64d9e65855e","Type":"ContainerStarted","Data":"f61e835baf1e36d2dbcc693bf63a81dfda08d4283bc54e72224ab5a90d228c53"}
Jul 27 19:02:53.608750 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.608716    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:02:53.627987 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.627935    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" podStartSLOduration=1.6279186 podStartE2EDuration="1.6279186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:53.626416085 +0000 UTC m=+2039.752270428" watchObservedRunningTime="2026-07-27 19:02:53.6279186 +0000 UTC m=+2039.753772942"
Jul 27 19:02:53.646051 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:02:53.646003    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" podStartSLOduration=1.6459909750000001 podStartE2EDuration="1.645990975s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:02:53.6447255 +0000 UTC m=+2039.770579851" watchObservedRunningTime="2026-07-27 19:02:53.645990975 +0000 UTC m=+2039.771845349"
Jul 27 19:03:02.681413 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:02.681379    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:03:04.075295 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.075268    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"]
Jul 27 19:03:04.078613 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.078595    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:04.082908 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.082883    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:03:04.082987 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.082928    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:03:04.088422 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.088402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"]
Jul 27 19:03:04.151107 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.151079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq\" (UID: \"ae1b69d5-e07c-4d27-889d-2b323732c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:04.251569 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.251550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq\" (UID: \"ae1b69d5-e07c-4d27-889d-2b323732c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:04.252128 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.252107    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq\" (UID: \"ae1b69d5-e07c-4d27-889d-2b323732c8c8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:04.389492 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.389417    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:04.521017 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.520986    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"]
Jul 27 19:03:04.525149 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:03:04.525126    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1b69d5_e07c_4d27_889d_2b323732c8c8.slice/crio-2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041 WatchSource:0}: Error finding container 2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041: Status 404 returned error can't find the container with id 2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041
Jul 27 19:03:04.614619 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.614595    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:03:04.614721 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.614670    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:03:04.657175 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:04.657093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq" event={"ID":"ae1b69d5-e07c-4d27-889d-2b323732c8c8","Type":"ContainerStarted","Data":"2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041"}
Jul 27 19:03:05.663491 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:05.663459    2567 generic.go:356] "Generic (PLEG): container finished" podID="ae1b69d5-e07c-4d27-889d-2b323732c8c8" containerID="c653f27c8745284da09fcb331d3b9dac7474ab3882d965f175a45c618c779264" exitCode=0
Jul 27 19:03:05.663843 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:05.663538    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq" event={"ID":"ae1b69d5-e07c-4d27-889d-2b323732c8c8","Type":"ContainerDied","Data":"c653f27c8745284da09fcb331d3b9dac7474ab3882d965f175a45c618c779264"}
Jul 27 19:03:06.795230 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:06.795206    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:06.869341 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:06.869315    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca\") pod \"ae1b69d5-e07c-4d27-889d-2b323732c8c8\" (UID: \"ae1b69d5-e07c-4d27-889d-2b323732c8c8\") "
Jul 27 19:03:06.869647 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:06.869626    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ae1b69d5-e07c-4d27-889d-2b323732c8c8" (UID: "ae1b69d5-e07c-4d27-889d-2b323732c8c8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:03:06.970151 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:06.970122    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ae1b69d5-e07c-4d27-889d-2b323732c8c8-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:03:07.680858 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:07.680835    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"
Jul 27 19:03:07.680858 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:07.680841    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq" event={"ID":"ae1b69d5-e07c-4d27-889d-2b323732c8c8","Type":"ContainerDied","Data":"2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041"}
Jul 27 19:03:07.681096 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:07.680890    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2412c9b39e22ab7689432027c67686f43a8f38b5ca0544a9a63b3b6ae6d62041"
Jul 27 19:03:14.514950 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.514915    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:03:14.515391 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.515191    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerName="payload-processing" containerID="cri-o://7324f9de16a9e6708702d46b2531a335929fcd0e8c8a8655357ca12f72fb3c4b" gracePeriod=30
Jul 27 19:03:14.521571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.521541    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:03:14.521788 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.521764    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerName="payload-pre-processing" containerID="cri-o://a17d71307f9f77a6eb469ab796904e792118cdae1aba9b7dd515843c5c6dd035" gracePeriod=30
Jul 27 19:03:14.613607 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.613574    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.35:9004: connect: connection refused"
Jul 27 19:03:14.613715 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.613582    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerName="payload-processing" probeResult="failure" output="dial tcp 10.133.0.36:9004: connect: connection refused"
Jul 27 19:03:14.712701 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.712671    2567 generic.go:356] "Generic (PLEG): container finished" podID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerID="7324f9de16a9e6708702d46b2531a335929fcd0e8c8a8655357ca12f72fb3c4b" exitCode=0
Jul 27 19:03:14.712854 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.712742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" event={"ID":"7c95b3ae-290f-45df-96b2-d64d9e65855e","Type":"ContainerDied","Data":"7324f9de16a9e6708702d46b2531a335929fcd0e8c8a8655357ca12f72fb3c4b"}
Jul 27 19:03:14.714332 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.714309    2567 generic.go:356] "Generic (PLEG): container finished" podID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerID="a17d71307f9f77a6eb469ab796904e792118cdae1aba9b7dd515843c5c6dd035" exitCode=0
Jul 27 19:03:14.714430 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.714354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" event={"ID":"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d","Type":"ContainerDied","Data":"a17d71307f9f77a6eb469ab796904e792118cdae1aba9b7dd515843c5c6dd035"}
Jul 27 19:03:14.790890 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.790859    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:03:14.794608 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.794570    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:03:14.825480 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.825431    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume\") pod \"7c95b3ae-290f-45df-96b2-d64d9e65855e\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") "
Jul 27 19:03:14.825597 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.825483    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnh8h\" (UniqueName: \"kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h\") pod \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") "
Jul 27 19:03:14.825597 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.825522    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume\") pod \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\" (UID: \"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d\") "
Jul 27 19:03:14.825597 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.825576    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vd4n2\" (UniqueName: \"kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2\") pod \"7c95b3ae-290f-45df-96b2-d64d9e65855e\" (UID: \"7c95b3ae-290f-45df-96b2-d64d9e65855e\") "
Jul 27 19:03:14.825927 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.825896    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c95b3ae-290f-45df-96b2-d64d9e65855e" (UID: "7c95b3ae-290f-45df-96b2-d64d9e65855e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:03:14.826107 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.826037    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" (UID: "a3354ea0-78e7-4f5a-9b80-d3df1d2f453d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:03:14.828216 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.828191    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h" (OuterVolumeSpecName: "kube-api-access-vnh8h") pod "a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" (UID: "a3354ea0-78e7-4f5a-9b80-d3df1d2f453d"). InnerVolumeSpecName "kube-api-access-vnh8h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:03:14.828856 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.828834    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2" (OuterVolumeSpecName: "kube-api-access-vd4n2") pod "7c95b3ae-290f-45df-96b2-d64d9e65855e" (UID: "7c95b3ae-290f-45df-96b2-d64d9e65855e"). InnerVolumeSpecName "kube-api-access-vd4n2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:03:14.926476 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.926452    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c95b3ae-290f-45df-96b2-d64d9e65855e-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:03:14.926476 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.926472    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnh8h\" (UniqueName: \"kubernetes.io/projected/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-kube-api-access-vnh8h\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:03:14.926595 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.926482    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:03:14.926595 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:14.926490    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vd4n2\" (UniqueName: \"kubernetes.io/projected/7c95b3ae-290f-45df-96b2-d64d9e65855e-kube-api-access-vd4n2\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:03:15.720016 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.719989    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"
Jul 27 19:03:15.720417 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.720034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct" event={"ID":"7c95b3ae-290f-45df-96b2-d64d9e65855e","Type":"ContainerDied","Data":"f61e835baf1e36d2dbcc693bf63a81dfda08d4283bc54e72224ab5a90d228c53"}
Jul 27 19:03:15.720417 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.720100    2567 scope.go:117] "RemoveContainer" containerID="7324f9de16a9e6708702d46b2531a335929fcd0e8c8a8655357ca12f72fb3c4b"
Jul 27 19:03:15.721530 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.721304    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4" event={"ID":"a3354ea0-78e7-4f5a-9b80-d3df1d2f453d","Type":"ContainerDied","Data":"135c477a4fc4a249a02e26d1f50a5e0e2ca86a0cfe165268796387cc96f0317d"}
Jul 27 19:03:15.721530 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.721317    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"
Jul 27 19:03:15.728490 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.728473    2567 scope.go:117] "RemoveContainer" containerID="a17d71307f9f77a6eb469ab796904e792118cdae1aba9b7dd515843c5c6dd035"
Jul 27 19:03:15.747210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.747185    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:03:15.752461 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.752426    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-9aed4c03-686f5fbbfd-8mwct"]
Jul 27 19:03:15.762735 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.762716    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:03:15.766621 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:15.766599    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-9aed4c03-67448c446d-wd4q4"]
Jul 27 19:03:16.382078 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:16.382045    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" path="/var/lib/kubelet/pods/7c95b3ae-290f-45df-96b2-d64d9e65855e/volumes"
Jul 27 19:03:16.382373 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:16.382360    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" path="/var/lib/kubelet/pods/a3354ea0-78e7-4f5a-9b80-d3df1d2f453d/volumes"
Jul 27 19:03:17.083120 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:17.083087    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:03:19.143994 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:19.143960    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"]
Jul 27 19:03:19.146236 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:19.146214    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-9aed4c03-dthvq"]
Jul 27 19:03:20.382073 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:20.382038    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae1b69d5-e07c-4d27-889d-2b323732c8c8" path="/var/lib/kubelet/pods/ae1b69d5-e07c-4d27-889d-2b323732c8c8/volumes"
Jul 27 19:03:50.699507 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699472    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699760    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae1b69d5-e07c-4d27-889d-2b323732c8c8" containerName="revoke-keys"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699770    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae1b69d5-e07c-4d27-889d-2b323732c8c8" containerName="revoke-keys"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699781    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerName="payload-pre-processing"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699787    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerName="payload-pre-processing"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699799    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerName="payload-processing"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699805    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerName="payload-processing"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699870    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae1b69d5-e07c-4d27-889d-2b323732c8c8" containerName="revoke-keys"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699878    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a3354ea0-78e7-4f5a-9b80-d3df1d2f453d" containerName="payload-pre-processing"
Jul 27 19:03:50.699959 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.699885    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c95b3ae-290f-45df-96b2-d64d9e65855e" containerName="payload-processing"
Jul 27 19:03:50.702948 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.702930    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.705828 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.705806    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fc9cd50f-dockercfg-xglcz\""
Jul 27 19:03:50.705958 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.705806    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fc9cd50f\""
Jul 27 19:03:50.711851 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.711823    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:03:50.730963 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.730914    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:03:50.734387 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.734369    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:50.749592 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.749570    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:03:50.793873 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.793846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8n64\" (UniqueName: \"kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.794021 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.793916    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.894498 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.894462    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8n64\" (UniqueName: \"kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.894637 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.894510    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:50.894637 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.894548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.894788 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.894768    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmg69\" (UniqueName: \"kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:50.895219 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.895203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.903056 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.903022    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8n64\" (UniqueName: \"kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64\") pod \"payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:50.995584 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.995524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmg69\" (UniqueName: \"kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:50.995584 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.995567    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:50.996141 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:50.996125    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:51.010487 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.010433    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmg69\" (UniqueName: \"kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69\") pod \"payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") " pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:51.013210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.013190    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:51.043731 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.043705    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:51.170948 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.170919    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:03:51.172612 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:03:51.172577    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e78c67e_9ab2_4517_8d5c_bebdc7524c77.slice/crio-cac52e704599a7ad2f919241ddcf6c0d4fe0ae95fcfd3cc409417d1bb0f08852 WatchSource:0}: Error finding container cac52e704599a7ad2f919241ddcf6c0d4fe0ae95fcfd3cc409417d1bb0f08852: Status 404 returned error can't find the container with id cac52e704599a7ad2f919241ddcf6c0d4fe0ae95fcfd3cc409417d1bb0f08852
Jul 27 19:03:51.195254 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.192924    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:03:51.876042 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.876004    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" event={"ID":"0dc909d7-0b0d-4fef-94ce-ef37cca23bff","Type":"ContainerStarted","Data":"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"}
Jul 27 19:03:51.876542 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.876069    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" event={"ID":"0dc909d7-0b0d-4fef-94ce-ef37cca23bff","Type":"ContainerStarted","Data":"50cfc600d65b87c14f894ea6f522a6c186ac9d07003e822f627b1bfe1a8378aa"}
Jul 27 19:03:51.876542 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.876133    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:03:51.877774 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.877749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" event={"ID":"6e78c67e-9ab2-4517-8d5c-bebdc7524c77","Type":"ContainerStarted","Data":"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"}
Jul 27 19:03:51.877884 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.877794    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" event={"ID":"6e78c67e-9ab2-4517-8d5c-bebdc7524c77","Type":"ContainerStarted","Data":"cac52e704599a7ad2f919241ddcf6c0d4fe0ae95fcfd3cc409417d1bb0f08852"}
Jul 27 19:03:51.877884 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.877833    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:03:51.893080 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.893033    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" podStartSLOduration=1.893020699 podStartE2EDuration="1.893020699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:03:51.891515622 +0000 UTC m=+2098.017369966" watchObservedRunningTime="2026-07-27 19:03:51.893020699 +0000 UTC m=+2098.018875041"
Jul 27 19:03:51.907988 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:51.907946    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" podStartSLOduration=1.9079330300000001 podStartE2EDuration="1.90793303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:03:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:03:51.907251281 +0000 UTC m=+2098.033105627" watchObservedRunningTime="2026-07-27 19:03:51.90793303 +0000 UTC m=+2098.033787371"
Jul 27 19:03:56.982977 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:03:56.982941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:04:02.884643 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:04:02.884614    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:04:02.885055 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:04:02.884741    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:04:07.485567 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:04:07.485536    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:04:24.387878 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:04:24.387843    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:04:54.508699 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:04:54.508633    2567 scope.go:117] "RemoveContainer" containerID="807987f3710a05fc445760f45df05d2ff322e836e37830aaa4deb5ba34bc4952"
Jul 27 19:05:54.525630 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:05:54.525602    2567 scope.go:117] "RemoveContainer" containerID="4d1b84a2758ce282a494b167329925504db117156b4e44282fc7a0a577fd0ae3"
Jul 27 19:06:54.541721 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:06:54.541689    2567 scope.go:117] "RemoveContainer" containerID="221fcab9211523aaf56a00ed22eca87c7c74f0828e62f935260d64e1fb1845c4"
Jul 27 19:06:54.549317 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:06:54.549299    2567 scope.go:117] "RemoveContainer" containerID="25619c7760dd0df83449ee9ead848fb9a4b81671be63cc985a44120be3a3b0d6"
Jul 27 19:07:27.601937 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.601908    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"]
Jul 27 19:07:27.604929 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.604913    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:27.607870 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.607848    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:07:27.607989 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.607906    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:07:27.628490 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.628470    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"]
Jul 27 19:07:27.714660 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.714635    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf\" (UID: \"4401e87d-0cec-4f42-b981-f65595a7a639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:27.815734 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.815707    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf\" (UID: \"4401e87d-0cec-4f42-b981-f65595a7a639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:27.816233 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.816215    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf\" (UID: \"4401e87d-0cec-4f42-b981-f65595a7a639\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:27.914377 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:27.914322    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:28.039977 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:28.039955    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"]
Jul 27 19:07:28.042428 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:07:28.042400    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4401e87d_0cec_4f42_b981_f65595a7a639.slice/crio-0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0 WatchSource:0}: Error finding container 0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0: Status 404 returned error can't find the container with id 0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0
Jul 27 19:07:28.795378 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:28.795343    2567 generic.go:356] "Generic (PLEG): container finished" podID="4401e87d-0cec-4f42-b981-f65595a7a639" containerID="c5618962aec2137335e07dc892e3262413a59e851d5762e75dbf39429c58c77e" exitCode=0
Jul 27 19:07:28.795747 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:28.795392    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf" event={"ID":"4401e87d-0cec-4f42-b981-f65595a7a639","Type":"ContainerDied","Data":"c5618962aec2137335e07dc892e3262413a59e851d5762e75dbf39429c58c77e"}
Jul 27 19:07:28.795747 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:28.795466    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf" event={"ID":"4401e87d-0cec-4f42-b981-f65595a7a639","Type":"ContainerStarted","Data":"0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0"}
Jul 27 19:07:29.933636 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:29.933614    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:30.033083 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.033054    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca\") pod \"4401e87d-0cec-4f42-b981-f65595a7a639\" (UID: \"4401e87d-0cec-4f42-b981-f65595a7a639\") "
Jul 27 19:07:30.033395 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.033372    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4401e87d-0cec-4f42-b981-f65595a7a639" (UID: "4401e87d-0cec-4f42-b981-f65595a7a639"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:30.134071 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.134009    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4401e87d-0cec-4f42-b981-f65595a7a639-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:07:30.807558 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.807527    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"
Jul 27 19:07:30.807706 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.807561    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf" event={"ID":"4401e87d-0cec-4f42-b981-f65595a7a639","Type":"ContainerDied","Data":"0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0"}
Jul 27 19:07:30.807706 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:30.807603    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f5cb76ecc6b14b2d350debcd848c0ac4965e76ac09292b63d1c054388dafad0"
Jul 27 19:07:41.406240 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:41.406207    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:07:43.270382 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.270351    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:07:43.270767 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.270588    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" podUID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" containerName="payload-processing" containerID="cri-o://ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09" gracePeriod=30
Jul 27 19:07:43.275711 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.275641    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:07:43.275916 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.275868    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" podUID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" containerName="payload-pre-processing" containerID="cri-o://2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817" gracePeriod=30
Jul 27 19:07:43.545505 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.545483    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:07:43.548599 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.548578    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:07:43.634656 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.634624    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume\") pod \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") "
Jul 27 19:07:43.634848 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.634662    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8n64\" (UniqueName: \"kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64\") pod \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\" (UID: \"6e78c67e-9ab2-4517-8d5c-bebdc7524c77\") "
Jul 27 19:07:43.634848 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.634679    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmg69\" (UniqueName: \"kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69\") pod \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") "
Jul 27 19:07:43.634848 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.634703    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume\") pod \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\" (UID: \"0dc909d7-0b0d-4fef-94ce-ef37cca23bff\") "
Jul 27 19:07:43.635109 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.635074    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e78c67e-9ab2-4517-8d5c-bebdc7524c77" (UID: "6e78c67e-9ab2-4517-8d5c-bebdc7524c77"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:43.635109 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.635102    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0dc909d7-0b0d-4fef-94ce-ef37cca23bff" (UID: "0dc909d7-0b0d-4fef-94ce-ef37cca23bff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:07:43.636882 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.636862    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64" (OuterVolumeSpecName: "kube-api-access-f8n64") pod "6e78c67e-9ab2-4517-8d5c-bebdc7524c77" (UID: "6e78c67e-9ab2-4517-8d5c-bebdc7524c77"). InnerVolumeSpecName "kube-api-access-f8n64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:43.637004 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.636984    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69" (OuterVolumeSpecName: "kube-api-access-jmg69") pod "0dc909d7-0b0d-4fef-94ce-ef37cca23bff" (UID: "0dc909d7-0b0d-4fef-94ce-ef37cca23bff"). InnerVolumeSpecName "kube-api-access-jmg69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:07:43.735823 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.735793    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:07:43.735823 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.735819    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8n64\" (UniqueName: \"kubernetes.io/projected/6e78c67e-9ab2-4517-8d5c-bebdc7524c77-kube-api-access-f8n64\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:07:43.735823 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.735828    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmg69\" (UniqueName: \"kubernetes.io/projected/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-kube-api-access-jmg69\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:07:43.736051 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.735836    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0dc909d7-0b0d-4fef-94ce-ef37cca23bff-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:07:43.865767 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.865688    2567 generic.go:356] "Generic (PLEG): container finished" podID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" containerID="ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09" exitCode=0
Jul 27 19:07:43.865767 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.865728    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"
Jul 27 19:07:43.865985 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.865772    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" event={"ID":"0dc909d7-0b0d-4fef-94ce-ef37cca23bff","Type":"ContainerDied","Data":"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"}
Jul 27 19:07:43.865985 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.865831    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng" event={"ID":"0dc909d7-0b0d-4fef-94ce-ef37cca23bff","Type":"ContainerDied","Data":"50cfc600d65b87c14f894ea6f522a6c186ac9d07003e822f627b1bfe1a8378aa"}
Jul 27 19:07:43.865985 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.865863    2567 scope.go:117] "RemoveContainer" containerID="ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"
Jul 27 19:07:43.867028 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.867004    2567 generic.go:356] "Generic (PLEG): container finished" podID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" containerID="2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817" exitCode=0
Jul 27 19:07:43.867116 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.867046    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"
Jul 27 19:07:43.867116 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.867053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" event={"ID":"6e78c67e-9ab2-4517-8d5c-bebdc7524c77","Type":"ContainerDied","Data":"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"}
Jul 27 19:07:43.867116 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.867086    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9" event={"ID":"6e78c67e-9ab2-4517-8d5c-bebdc7524c77","Type":"ContainerDied","Data":"cac52e704599a7ad2f919241ddcf6c0d4fe0ae95fcfd3cc409417d1bb0f08852"}
Jul 27 19:07:43.875497 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.875474    2567 scope.go:117] "RemoveContainer" containerID="ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"
Jul 27 19:07:43.875802 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:07:43.875784    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09\": container with ID starting with ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09 not found: ID does not exist" containerID="ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"
Jul 27 19:07:43.875888 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.875810    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09"} err="failed to get container status \"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09\": rpc error: code = NotFound desc = could not find container \"ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09\": container with ID starting with ba85b1e2dc3c8f706e00c0ab63147356662c7c98a94ab237a4ca16b9ed118a09 not found: ID does not exist"
Jul 27 19:07:43.875888 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.875827    2567 scope.go:117] "RemoveContainer" containerID="2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"
Jul 27 19:07:43.883625 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.883610    2567 scope.go:117] "RemoveContainer" containerID="2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"
Jul 27 19:07:43.883875 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:07:43.883858    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817\": container with ID starting with 2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817 not found: ID does not exist" containerID="2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"
Jul 27 19:07:43.883933 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.883881    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817"} err="failed to get container status \"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817\": rpc error: code = NotFound desc = could not find container \"2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817\": container with ID starting with 2634bc59c7c3e706ff1b40797533c445974a6046fa24d0c3db7518acd9c04817 not found: ID does not exist"
Jul 27 19:07:43.891608 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.891587    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:07:43.896935 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.896916    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-fc9cd50f-686648f894-mb8ng"]
Jul 27 19:07:43.911251 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.911228    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:07:43.913667 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:43.913646    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fc9cd50f-76995dfd8d-5ldq9"]
Jul 27 19:07:44.381919 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:44.381892    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" path="/var/lib/kubelet/pods/0dc909d7-0b0d-4fef-94ce-ef37cca23bff/volumes"
Jul 27 19:07:44.382292 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:44.382225    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" path="/var/lib/kubelet/pods/6e78c67e-9ab2-4517-8d5c-bebdc7524c77/volumes"
Jul 27 19:07:47.761597 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:47.761523    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"]
Jul 27 19:07:47.767593 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:47.767563    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fc9cd50f-8jjwf"]
Jul 27 19:07:48.384577 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:48.382664    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4401e87d-0cec-4f42-b981-f65595a7a639" path="/var/lib/kubelet/pods/4401e87d-0cec-4f42-b981-f65595a7a639/volumes"
Jul 27 19:07:52.022875 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:07:52.022844    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:08:51.187181 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:08:51.187144    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:09:01.412327 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:01.412283    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:09:49.651321 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651289    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651589    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" containerName="payload-pre-processing"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651602    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" containerName="payload-pre-processing"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651615    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4401e87d-0cec-4f42-b981-f65595a7a639" containerName="revoke-keys"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651620    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="4401e87d-0cec-4f42-b981-f65595a7a639" containerName="revoke-keys"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651632    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" containerName="payload-processing"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651639    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" containerName="payload-processing"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651687    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="4401e87d-0cec-4f42-b981-f65595a7a639" containerName="revoke-keys"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651695    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dc909d7-0b0d-4fef-94ce-ef37cca23bff" containerName="payload-processing"
Jul 27 19:09:49.651785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.651701    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e78c67e-9ab2-4517-8d5c-bebdc7524c77" containerName="payload-pre-processing"
Jul 27 19:09:49.654494 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.654478    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.658460 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.658349    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-f9caec\""
Jul 27 19:09:49.669554 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.669533    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:09:49.680839 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.680817    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:09:49.683891 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.683873    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.687014 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.686991    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-f9caec-dockercfg-h2xbj\""
Jul 27 19:09:49.697866 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.697849    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:09:49.726052 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.726029    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szqp7\" (UniqueName: \"kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.726147 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.726137    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.827006 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.826965    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.827143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.827020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9jlw\" (UniqueName: \"kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.827143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.827051    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.827143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.827085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szqp7\" (UniqueName: \"kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.827818 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.827799    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.837948 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.837926    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szqp7\" (UniqueName: \"kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7\") pod \"payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.928204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.928152    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9jlw\" (UniqueName: \"kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.928204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.928181    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.928811 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.928795    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.939180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.939160    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9jlw\" (UniqueName: \"kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw\") pod \"payload-processing-e2e-inf-a-f9caec-54f474765b-476ss\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") " pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:49.964500 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.964475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:49.993052 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:49.993022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:50.112627 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.110373    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:09:50.114584 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:09:50.114550    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f7b538e_9c10_44f5_93b0_48d351f45a9b.slice/crio-dd47c6a98c53b932d22f23a53f599bd15edd69c997aed78aa2202ae369884a34 WatchSource:0}: Error finding container dd47c6a98c53b932d22f23a53f599bd15edd69c997aed78aa2202ae369884a34: Status 404 returned error can't find the container with id dd47c6a98c53b932d22f23a53f599bd15edd69c997aed78aa2202ae369884a34
Jul 27 19:09:50.346754 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.346730    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:09:50.348846 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:09:50.348820    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2810347d_e3ac_441e_96c3_b61e361169b0.slice/crio-ed4ced5ea4b58e9bc817502c7e7c2c06e5019c8b22c921e51227741210e71835 WatchSource:0}: Error finding container ed4ced5ea4b58e9bc817502c7e7c2c06e5019c8b22c921e51227741210e71835: Status 404 returned error can't find the container with id ed4ced5ea4b58e9bc817502c7e7c2c06e5019c8b22c921e51227741210e71835
Jul 27 19:09:50.416615 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.416580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" event={"ID":"2810347d-e3ac-441e-96c3-b61e361169b0","Type":"ContainerStarted","Data":"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"}
Jul 27 19:09:50.416752 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.416649    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" event={"ID":"2810347d-e3ac-441e-96c3-b61e361169b0","Type":"ContainerStarted","Data":"ed4ced5ea4b58e9bc817502c7e7c2c06e5019c8b22c921e51227741210e71835"}
Jul 27 19:09:50.416752 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.416694    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:09:50.418088 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.418065    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" event={"ID":"0f7b538e-9c10-44f5-93b0-48d351f45a9b","Type":"ContainerStarted","Data":"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"}
Jul 27 19:09:50.418197 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.418100    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" event={"ID":"0f7b538e-9c10-44f5-93b0-48d351f45a9b","Type":"ContainerStarted","Data":"dd47c6a98c53b932d22f23a53f599bd15edd69c997aed78aa2202ae369884a34"}
Jul 27 19:09:50.418254 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.418197    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:09:50.441149 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.441109    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" podStartSLOduration=1.4410975129999999 podStartE2EDuration="1.441097513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:50.439960836 +0000 UTC m=+2456.565815179" watchObservedRunningTime="2026-07-27 19:09:50.441097513 +0000 UTC m=+2456.566951855"
Jul 27 19:09:50.461525 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:50.461484    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" podStartSLOduration=1.461471527 podStartE2EDuration="1.461471527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:50.460179507 +0000 UTC m=+2456.586033851" watchObservedRunningTime="2026-07-27 19:09:50.461471527 +0000 UTC m=+2456.587325868"
Jul 27 19:09:53.785543 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:53.785514    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:09:54.588241 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:54.588216    2567 scope.go:117] "RemoveContainer" containerID="c653f27c8745284da09fcb331d3b9dac7474ab3882d965f175a45c618c779264"
Jul 27 19:09:57.897907 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.897870    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:09:57.902929 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.902907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:57.905969 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.905950    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-9abe8e\""
Jul 27 19:09:57.906090 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.905952    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-9abe8e-dockercfg-x4n8h\""
Jul 27 19:09:57.910826 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.910797    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:09:57.914426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.914407    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:09:57.914549 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.914511    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:57.928076 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.928049    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:09:57.987130 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.987106    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4txps\" (UniqueName: \"kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:57.987231 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.987162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4dw\" (UniqueName: \"kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:57.987231 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.987198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:57.987319 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:57.987249    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.088563 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.088524    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.088725 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.088617    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4txps\" (UniqueName: \"kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.088725 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.088666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4dw\" (UniqueName: \"kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.088725 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.088699    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.089259 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.089234    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.089472 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.089434    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.099100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.099074    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4txps\" (UniqueName: \"kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps\") pod \"payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") " pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.099196 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.099106    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4dw\" (UniqueName: \"kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw\") pod \"payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.214761 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.214737    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.225849 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.225825    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.361763 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.361725    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:09:58.363975 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:09:58.363933    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b08f53b_4b6b_4a37_b7f0_dfd9bde57457.slice/crio-9629ff30049789143d71f5a2990d0de9362152efaa39574fc33e8ccc5a3fdea0 WatchSource:0}: Error finding container 9629ff30049789143d71f5a2990d0de9362152efaa39574fc33e8ccc5a3fdea0: Status 404 returned error can't find the container with id 9629ff30049789143d71f5a2990d0de9362152efaa39574fc33e8ccc5a3fdea0
Jul 27 19:09:58.386953 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.386932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:09:58.395585 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:09:58.395556    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d152395_36ae_4c49_b13a_30ec4cb9f128.slice/crio-2aab75a6670f7bb86259fee921fd1f828e724fcabd748649ddc93fe658d62b2e WatchSource:0}: Error finding container 2aab75a6670f7bb86259fee921fd1f828e724fcabd748649ddc93fe658d62b2e: Status 404 returned error can't find the container with id 2aab75a6670f7bb86259fee921fd1f828e724fcabd748649ddc93fe658d62b2e
Jul 27 19:09:58.455271 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.455238    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" event={"ID":"1d152395-36ae-4c49-b13a-30ec4cb9f128","Type":"ContainerStarted","Data":"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"}
Jul 27 19:09:58.455416 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.455400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:09:58.455516 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.455470    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" event={"ID":"1d152395-36ae-4c49-b13a-30ec4cb9f128","Type":"ContainerStarted","Data":"2aab75a6670f7bb86259fee921fd1f828e724fcabd748649ddc93fe658d62b2e"}
Jul 27 19:09:58.456763 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.456742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" event={"ID":"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457","Type":"ContainerStarted","Data":"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"}
Jul 27 19:09:58.456877 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.456778    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" event={"ID":"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457","Type":"ContainerStarted","Data":"9629ff30049789143d71f5a2990d0de9362152efaa39574fc33e8ccc5a3fdea0"}
Jul 27 19:09:58.456877 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.456807    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:09:58.475924 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.475826    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" podStartSLOduration=1.475811632 podStartE2EDuration="1.475811632s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:58.474160895 +0000 UTC m=+2464.600015254" watchObservedRunningTime="2026-07-27 19:09:58.475811632 +0000 UTC m=+2464.601665973"
Jul 27 19:09:58.491435 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:09:58.491308    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" podStartSLOduration=1.491288647 podStartE2EDuration="1.491288647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:09:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:09:58.490986654 +0000 UTC m=+2464.616840999" watchObservedRunningTime="2026-07-27 19:09:58.491288647 +0000 UTC m=+2464.617142991"
Jul 27 19:10:01.425043 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:01.425012    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:10:01.425431 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:01.425092    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:10:03.591285 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:03.591247    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:10:09.463771 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:09.463731    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:10:09.464149 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:09.463816    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:10:21.182680 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:21.182650    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:10:34.086944 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:34.086911    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:10:46.678938 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:10:46.678860    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:11:17.567209 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.567172    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"]
Jul 27 19:11:17.571056 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.571026    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:17.574016 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.573990    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:11:17.574150 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.574035    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:11:17.577960 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.577932    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"]
Jul 27 19:11:17.734784 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.734739    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d\" (UID: \"7ba7088e-a025-40ee-a9e9-23ce26829937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:17.835629 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.835550    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d\" (UID: \"7ba7088e-a025-40ee-a9e9-23ce26829937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:17.836184 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.836164    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d\" (UID: \"7ba7088e-a025-40ee-a9e9-23ce26829937\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:17.884572 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:17.884539    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:18.026589 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:18.026563    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"]
Jul 27 19:11:18.028649 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:11:18.028622    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba7088e_a025_40ee_a9e9_23ce26829937.slice/crio-55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf WatchSource:0}: Error finding container 55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf: Status 404 returned error can't find the container with id 55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf
Jul 27 19:11:18.805059 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:18.805028    2567 generic.go:356] "Generic (PLEG): container finished" podID="7ba7088e-a025-40ee-a9e9-23ce26829937" containerID="7cf24981cb630b35b6adf4951bc8d062cc02411458976a05e2ce5860901a1e03" exitCode=0
Jul 27 19:11:18.805470 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:18.805081    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d" event={"ID":"7ba7088e-a025-40ee-a9e9-23ce26829937","Type":"ContainerDied","Data":"7cf24981cb630b35b6adf4951bc8d062cc02411458976a05e2ce5860901a1e03"}
Jul 27 19:11:18.805470 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:18.805124    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d" event={"ID":"7ba7088e-a025-40ee-a9e9-23ce26829937","Type":"ContainerStarted","Data":"55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf"}
Jul 27 19:11:19.936035 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:19.936016    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:20.057978 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.057948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca\") pod \"7ba7088e-a025-40ee-a9e9-23ce26829937\" (UID: \"7ba7088e-a025-40ee-a9e9-23ce26829937\") "
Jul 27 19:11:20.058262 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.058241    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7ba7088e-a025-40ee-a9e9-23ce26829937" (UID: "7ba7088e-a025-40ee-a9e9-23ce26829937"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:20.159581 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.159520    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7ba7088e-a025-40ee-a9e9-23ce26829937-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:20.813985 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.813950    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d" event={"ID":"7ba7088e-a025-40ee-a9e9-23ce26829937","Type":"ContainerDied","Data":"55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf"}
Jul 27 19:11:20.813985 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.813970    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"
Jul 27 19:11:20.814152 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:20.813995    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="55cfbcf2d239b6042804c63a3554b153ce004f72444f498efd31984be40e51cf"
Jul 27 19:11:21.177183 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:21.177118    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:11:28.021705 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.021466    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:11:28.022895 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.021798    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" podUID="2810347d-e3ac-441e-96c3-b61e361169b0" containerName="payload-processing" containerID="cri-o://a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01" gracePeriod=30
Jul 27 19:11:28.033015 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.032939    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:11:28.033737 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.033672    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" podUID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" containerName="payload-pre-processing" containerID="cri-o://308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3" gracePeriod=30
Jul 27 19:11:28.311707 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.311680    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:11:28.314370 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.314341    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:11:28.326647 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.326623    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szqp7\" (UniqueName: \"kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7\") pod \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") "
Jul 27 19:11:28.326802 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.326683    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f9jlw\" (UniqueName: \"kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw\") pod \"2810347d-e3ac-441e-96c3-b61e361169b0\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") "
Jul 27 19:11:28.326802 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.326711    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume\") pod \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\" (UID: \"0f7b538e-9c10-44f5-93b0-48d351f45a9b\") "
Jul 27 19:11:28.326802 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.326727    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume\") pod \"2810347d-e3ac-441e-96c3-b61e361169b0\" (UID: \"2810347d-e3ac-441e-96c3-b61e361169b0\") "
Jul 27 19:11:28.327143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.327117    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0f7b538e-9c10-44f5-93b0-48d351f45a9b" (UID: "0f7b538e-9c10-44f5-93b0-48d351f45a9b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:28.327205 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.327146    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2810347d-e3ac-441e-96c3-b61e361169b0" (UID: "2810347d-e3ac-441e-96c3-b61e361169b0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:28.329273 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.329197    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7" (OuterVolumeSpecName: "kube-api-access-szqp7") pod "0f7b538e-9c10-44f5-93b0-48d351f45a9b" (UID: "0f7b538e-9c10-44f5-93b0-48d351f45a9b"). InnerVolumeSpecName "kube-api-access-szqp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:28.329674 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.329641    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw" (OuterVolumeSpecName: "kube-api-access-f9jlw") pod "2810347d-e3ac-441e-96c3-b61e361169b0" (UID: "2810347d-e3ac-441e-96c3-b61e361169b0"). InnerVolumeSpecName "kube-api-access-f9jlw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:28.428130 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.428095    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szqp7\" (UniqueName: \"kubernetes.io/projected/0f7b538e-9c10-44f5-93b0-48d351f45a9b-kube-api-access-szqp7\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:28.428130 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.428124    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9jlw\" (UniqueName: \"kubernetes.io/projected/2810347d-e3ac-441e-96c3-b61e361169b0-kube-api-access-f9jlw\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:28.428130 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.428133    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0f7b538e-9c10-44f5-93b0-48d351f45a9b-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:28.428335 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.428142    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2810347d-e3ac-441e-96c3-b61e361169b0-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:28.852823 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.852785    2567 generic.go:356] "Generic (PLEG): container finished" podID="2810347d-e3ac-441e-96c3-b61e361169b0" containerID="a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01" exitCode=0
Jul 27 19:11:28.853011 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.852833    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"
Jul 27 19:11:28.853011 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.852872    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" event={"ID":"2810347d-e3ac-441e-96c3-b61e361169b0","Type":"ContainerDied","Data":"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"}
Jul 27 19:11:28.853011 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.852926    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss" event={"ID":"2810347d-e3ac-441e-96c3-b61e361169b0","Type":"ContainerDied","Data":"ed4ced5ea4b58e9bc817502c7e7c2c06e5019c8b22c921e51227741210e71835"}
Jul 27 19:11:28.853011 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.852958    2567 scope.go:117] "RemoveContainer" containerID="a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"
Jul 27 19:11:28.854276 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.854252    2567 generic.go:356] "Generic (PLEG): container finished" podID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" containerID="308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3" exitCode=0
Jul 27 19:11:28.854393 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.854297    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"
Jul 27 19:11:28.854541 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.854461    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" event={"ID":"0f7b538e-9c10-44f5-93b0-48d351f45a9b","Type":"ContainerDied","Data":"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"}
Jul 27 19:11:28.854615 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.854572    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9" event={"ID":"0f7b538e-9c10-44f5-93b0-48d351f45a9b","Type":"ContainerDied","Data":"dd47c6a98c53b932d22f23a53f599bd15edd69c997aed78aa2202ae369884a34"}
Jul 27 19:11:28.861639 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.861625    2567 scope.go:117] "RemoveContainer" containerID="a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"
Jul 27 19:11:28.861953 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:11:28.861929    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01\": container with ID starting with a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01 not found: ID does not exist" containerID="a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"
Jul 27 19:11:28.862070 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.861960    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01"} err="failed to get container status \"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01\": rpc error: code = NotFound desc = could not find container \"a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01\": container with ID starting with a7dc4cb03baa7d8a850a54a05e2ed6560b581cac1363957c1f39b3b7ae235e01 not found: ID does not exist"
Jul 27 19:11:28.862070 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.861982    2567 scope.go:117] "RemoveContainer" containerID="308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"
Jul 27 19:11:28.869287 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.869267    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:11:28.869800 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.869783    2567 scope.go:117] "RemoveContainer" containerID="308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"
Jul 27 19:11:28.870039 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:11:28.870021    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3\": container with ID starting with 308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3 not found: ID does not exist" containerID="308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"
Jul 27 19:11:28.870103 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.870048    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3"} err="failed to get container status \"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3\": rpc error: code = NotFound desc = could not find container \"308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3\": container with ID starting with 308df5c475e104145a0e8eeb2f315c82ddda4fa0e75b61a18957a069dca6ead3 not found: ID does not exist"
Jul 27 19:11:28.872911 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.872891    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-f9caec-54f474765b-476ss"]
Jul 27 19:11:28.883506 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.883484    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:11:28.886284 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:28.886260    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-f9caec-75cb654776-xmpf9"]
Jul 27 19:11:30.382633 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:30.382593    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" path="/var/lib/kubelet/pods/0f7b538e-9c10-44f5-93b0-48d351f45a9b/volumes"
Jul 27 19:11:30.383118 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:30.383089    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2810347d-e3ac-441e-96c3-b61e361169b0" path="/var/lib/kubelet/pods/2810347d-e3ac-441e-96c3-b61e361169b0/volumes"
Jul 27 19:11:32.650456 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:32.650415    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"]
Jul 27 19:11:32.653482 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:32.653459    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-f9caec-4c67d"]
Jul 27 19:11:34.381984 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:34.381943    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ba7088e-a025-40ee-a9e9-23ce26829937" path="/var/lib/kubelet/pods/7ba7088e-a025-40ee-a9e9-23ce26829937/volumes"
Jul 27 19:11:37.083688 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:37.083653    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:11:40.942026 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.941991    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"]
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942293    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" containerName="payload-pre-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942303    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" containerName="payload-pre-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942313    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ba7088e-a025-40ee-a9e9-23ce26829937" containerName="revoke-keys"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942318    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ba7088e-a025-40ee-a9e9-23ce26829937" containerName="revoke-keys"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942337    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2810347d-e3ac-441e-96c3-b61e361169b0" containerName="payload-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942343    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2810347d-e3ac-441e-96c3-b61e361169b0" containerName="payload-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942403    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2810347d-e3ac-441e-96c3-b61e361169b0" containerName="payload-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942410    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f7b538e-9c10-44f5-93b0-48d351f45a9b" containerName="payload-pre-processing"
Jul 27 19:11:40.942483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.942416    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ba7088e-a025-40ee-a9e9-23ce26829937" containerName="revoke-keys"
Jul 27 19:11:40.944315 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.944301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:40.948636 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.948611    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:11:40.952497 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.952476    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:11:40.982926 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:40.982895    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"]
Jul 27 19:11:41.029456 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.029413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl\" (UID: \"679bbe43-6540-4903-9e34-87ce380437f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:41.130944 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.130906    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl\" (UID: \"679bbe43-6540-4903-9e34-87ce380437f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:41.131577 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.131561    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl\" (UID: \"679bbe43-6540-4903-9e34-87ce380437f6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:41.254429 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.254327    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:41.405933 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.405901    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"]
Jul 27 19:11:41.408785 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:11:41.408756    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod679bbe43_6540_4903_9e34_87ce380437f6.slice/crio-5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c WatchSource:0}: Error finding container 5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c: Status 404 returned error can't find the container with id 5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c
Jul 27 19:11:41.914132 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.914035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl" event={"ID":"679bbe43-6540-4903-9e34-87ce380437f6","Type":"ContainerStarted","Data":"e0ccf12746c52187f3ecb9d6ca61a8e9e39d4bfe441b55ec2817a0b3dd380a98"}
Jul 27 19:11:41.914132 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.914101    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl" event={"ID":"679bbe43-6540-4903-9e34-87ce380437f6","Type":"ContainerStarted","Data":"5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c"}
Jul 27 19:11:41.940817 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:41.940761    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl" podStartSLOduration=1.940744255 podStartE2EDuration="1.940744255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:11:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:11:41.939846406 +0000 UTC m=+2568.065700745" watchObservedRunningTime="2026-07-27 19:11:41.940744255 +0000 UTC m=+2568.066598652"
Jul 27 19:11:42.922526 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:42.922494    2567 generic.go:356] "Generic (PLEG): container finished" podID="679bbe43-6540-4903-9e34-87ce380437f6" containerID="e0ccf12746c52187f3ecb9d6ca61a8e9e39d4bfe441b55ec2817a0b3dd380a98" exitCode=0
Jul 27 19:11:42.922944 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:42.922588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl" event={"ID":"679bbe43-6540-4903-9e34-87ce380437f6","Type":"ContainerDied","Data":"e0ccf12746c52187f3ecb9d6ca61a8e9e39d4bfe441b55ec2817a0b3dd380a98"}
Jul 27 19:11:44.056937 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.056913    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:44.158169 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.158134    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca\") pod \"679bbe43-6540-4903-9e34-87ce380437f6\" (UID: \"679bbe43-6540-4903-9e34-87ce380437f6\") "
Jul 27 19:11:44.158528 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.158504    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "679bbe43-6540-4903-9e34-87ce380437f6" (UID: "679bbe43-6540-4903-9e34-87ce380437f6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:44.259106 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.259065    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/679bbe43-6540-4903-9e34-87ce380437f6-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:44.933704 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.933665    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl" event={"ID":"679bbe43-6540-4903-9e34-87ce380437f6","Type":"ContainerDied","Data":"5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c"}
Jul 27 19:11:44.933880 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.933741    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5b63d91788c079449e0088e21f359e05c6b13f94fbf98df60e34e91426787e6c"
Jul 27 19:11:44.933880 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:44.933683    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"
Jul 27 19:11:51.306064 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.306032    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:11:51.306565 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.306269    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" podUID="1d152395-36ae-4c49-b13a-30ec4cb9f128" containerName="payload-processing" containerID="cri-o://573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5" gracePeriod=30
Jul 27 19:11:51.314187 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.314157    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:11:51.314390 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.314362    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" podUID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" containerName="payload-pre-processing" containerID="cri-o://9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5" gracePeriod=30
Jul 27 19:11:51.589497 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.589475    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:11:51.592064 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.592047    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:11:51.715265 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715234    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume\") pod \"1d152395-36ae-4c49-b13a-30ec4cb9f128\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") "
Jul 27 19:11:51.715426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715286    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5f4dw\" (UniqueName: \"kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw\") pod \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") "
Jul 27 19:11:51.715426 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715324    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4txps\" (UniqueName: \"kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps\") pod \"1d152395-36ae-4c49-b13a-30ec4cb9f128\" (UID: \"1d152395-36ae-4c49-b13a-30ec4cb9f128\") "
Jul 27 19:11:51.715595 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715425    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume\") pod \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\" (UID: \"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457\") "
Jul 27 19:11:51.715784 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715743    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1d152395-36ae-4c49-b13a-30ec4cb9f128" (UID: "1d152395-36ae-4c49-b13a-30ec4cb9f128"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:51.715784 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.715763    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" (UID: "9b08f53b-4b6b-4a37-b7f0-dfd9bde57457"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:11:51.717696 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.717676    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw" (OuterVolumeSpecName: "kube-api-access-5f4dw") pod "9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" (UID: "9b08f53b-4b6b-4a37-b7f0-dfd9bde57457"). InnerVolumeSpecName "kube-api-access-5f4dw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:51.717792 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.717712    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps" (OuterVolumeSpecName: "kube-api-access-4txps") pod "1d152395-36ae-4c49-b13a-30ec4cb9f128" (UID: "1d152395-36ae-4c49-b13a-30ec4cb9f128"). InnerVolumeSpecName "kube-api-access-4txps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:11:51.816211 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.816191    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:51.816211 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.816210    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1d152395-36ae-4c49-b13a-30ec4cb9f128-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:51.816342 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.816219    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5f4dw\" (UniqueName: \"kubernetes.io/projected/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457-kube-api-access-5f4dw\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:51.816342 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.816228    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4txps\" (UniqueName: \"kubernetes.io/projected/1d152395-36ae-4c49-b13a-30ec4cb9f128-kube-api-access-4txps\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:11:51.965827 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.965792    2567 generic.go:356] "Generic (PLEG): container finished" podID="1d152395-36ae-4c49-b13a-30ec4cb9f128" containerID="573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5" exitCode=0
Jul 27 19:11:51.966013 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.965836    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"
Jul 27 19:11:51.966013 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.965876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" event={"ID":"1d152395-36ae-4c49-b13a-30ec4cb9f128","Type":"ContainerDied","Data":"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"}
Jul 27 19:11:51.966013 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.965933    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2" event={"ID":"1d152395-36ae-4c49-b13a-30ec4cb9f128","Type":"ContainerDied","Data":"2aab75a6670f7bb86259fee921fd1f828e724fcabd748649ddc93fe658d62b2e"}
Jul 27 19:11:51.966013 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.965960    2567 scope.go:117] "RemoveContainer" containerID="573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"
Jul 27 19:11:51.967241 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.967218    2567 generic.go:356] "Generic (PLEG): container finished" podID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" containerID="9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5" exitCode=0
Jul 27 19:11:51.967353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.967250    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" event={"ID":"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457","Type":"ContainerDied","Data":"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"}
Jul 27 19:11:51.967353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.967272    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"
Jul 27 19:11:51.967353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.967296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9" event={"ID":"9b08f53b-4b6b-4a37-b7f0-dfd9bde57457","Type":"ContainerDied","Data":"9629ff30049789143d71f5a2990d0de9362152efaa39574fc33e8ccc5a3fdea0"}
Jul 27 19:11:51.974856 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.974740    2567 scope.go:117] "RemoveContainer" containerID="573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"
Jul 27 19:11:51.975156 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:11:51.975124    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5\": container with ID starting with 573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5 not found: ID does not exist" containerID="573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"
Jul 27 19:11:51.975308 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.975164    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5"} err="failed to get container status \"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5\": rpc error: code = NotFound desc = could not find container \"573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5\": container with ID starting with 573c7d4d86c395e11ca282fd303434b7f1882470fe3dcc9eb6b6a6a2023901d5 not found: ID does not exist"
Jul 27 19:11:51.975308 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.975189    2567 scope.go:117] "RemoveContainer" containerID="9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"
Jul 27 19:11:51.982967 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.982951    2567 scope.go:117] "RemoveContainer" containerID="9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"
Jul 27 19:11:51.983186 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:11:51.983166    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5\": container with ID starting with 9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5 not found: ID does not exist" containerID="9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"
Jul 27 19:11:51.983252 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.983197    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5"} err="failed to get container status \"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5\": rpc error: code = NotFound desc = could not find container \"9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5\": container with ID starting with 9d0e207c06bbe7a378dd85d636b7b01eab4893332319cbeae804991418f58dd5 not found: ID does not exist"
Jul 27 19:11:51.991935 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.991915    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:11:51.999004 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:51.998982    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-9abe8e-688f5df8f6-5wmx2"]
Jul 27 19:11:52.014223 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:52.014201    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:11:52.022093 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:52.022068    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-9abe8e-5554994d5b-hrfg9"]
Jul 27 19:11:52.382282 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:52.382207    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d152395-36ae-4c49-b13a-30ec4cb9f128" path="/var/lib/kubelet/pods/1d152395-36ae-4c49-b13a-30ec4cb9f128/volumes"
Jul 27 19:11:52.382634 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:52.382618    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" path="/var/lib/kubelet/pods/9b08f53b-4b6b-4a37-b7f0-dfd9bde57457/volumes"
Jul 27 19:11:54.212349 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:54.212310    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:11:55.894649 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:55.894614    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"]
Jul 27 19:11:55.896290 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:55.896268    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9abe8e-ttcgl"]
Jul 27 19:11:56.381541 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:11:56.381511    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="679bbe43-6540-4903-9e34-87ce380437f6" path="/var/lib/kubelet/pods/679bbe43-6540-4903-9e34-87ce380437f6/volumes"
Jul 27 19:12:07.392333 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392304    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392621    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" containerName="payload-pre-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392633    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" containerName="payload-pre-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392642    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d152395-36ae-4c49-b13a-30ec4cb9f128" containerName="payload-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392648    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d152395-36ae-4c49-b13a-30ec4cb9f128" containerName="payload-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392660    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="679bbe43-6540-4903-9e34-87ce380437f6" containerName="revoke-keys"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392666    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="679bbe43-6540-4903-9e34-87ce380437f6" containerName="revoke-keys"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392717    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b08f53b-4b6b-4a37-b7f0-dfd9bde57457" containerName="payload-pre-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392725    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d152395-36ae-4c49-b13a-30ec4cb9f128" containerName="payload-processing"
Jul 27 19:12:07.392796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.392732    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="679bbe43-6540-4903-9e34-87ce380437f6" containerName="revoke-keys"
Jul 27 19:12:07.395595 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.395579    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.409862 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.409844    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-bf852f\""
Jul 27 19:12:07.413087 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.413069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:07.497521 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.497486    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:07.500920 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.500903    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.510709 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.510679    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-bf852f-dockercfg-w7966\""
Jul 27 19:12:07.534115 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.534085    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:07.552993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.552960    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqtbh\" (UniqueName: \"kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.553343 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.553303    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.654562 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.654464    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqtbh\" (UniqueName: \"kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.654738 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.654564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.654738 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.654596    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5kjr\" (UniqueName: \"kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.654738 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.654625    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.655338 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.655312    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.663917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.663892    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqtbh\" (UniqueName: \"kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh\") pod \"payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.704733 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.704701    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:07.763507 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.761955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.763507 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.762004    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5kjr\" (UniqueName: \"kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.763507 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.763181    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.781065 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.780924    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5kjr\" (UniqueName: \"kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr\") pod \"payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") " pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.815790 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.815762    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:07.865296 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.865270    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:07.868375 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:07.867980    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod527661f0_7f8a_4f7f_9456_ca01bd7a0a1d.slice/crio-db709a145aed5c15c46950ae6ee29d485025ebc8abfceea6121edaa25a61b7a4 WatchSource:0}: Error finding container db709a145aed5c15c46950ae6ee29d485025ebc8abfceea6121edaa25a61b7a4: Status 404 returned error can't find the container with id db709a145aed5c15c46950ae6ee29d485025ebc8abfceea6121edaa25a61b7a4
Jul 27 19:12:07.963123 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:07.963095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:07.966139 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:07.966112    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644bc888_9bb9_4f4e_9056_c9a503dca6e8.slice/crio-ba6aee2f8695a92066e2a48477bc5db0ca12600f8a18ef0e152383811c5157d2 WatchSource:0}: Error finding container ba6aee2f8695a92066e2a48477bc5db0ca12600f8a18ef0e152383811c5157d2: Status 404 returned error can't find the container with id ba6aee2f8695a92066e2a48477bc5db0ca12600f8a18ef0e152383811c5157d2
Jul 27 19:12:08.043248 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.043208    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" event={"ID":"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d","Type":"ContainerStarted","Data":"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"}
Jul 27 19:12:08.043590 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.043268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" event={"ID":"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d","Type":"ContainerStarted","Data":"db709a145aed5c15c46950ae6ee29d485025ebc8abfceea6121edaa25a61b7a4"}
Jul 27 19:12:08.043590 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.043297    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:08.044926 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.044903    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" event={"ID":"644bc888-9bb9-4f4e-9056-c9a503dca6e8","Type":"ContainerStarted","Data":"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"}
Jul 27 19:12:08.045065 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.044948    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" event={"ID":"644bc888-9bb9-4f4e-9056-c9a503dca6e8","Type":"ContainerStarted","Data":"ba6aee2f8695a92066e2a48477bc5db0ca12600f8a18ef0e152383811c5157d2"}
Jul 27 19:12:08.045065 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.045000    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:08.061594 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.061554    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" podStartSLOduration=1.061539158 podStartE2EDuration="1.061539158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:08.060601061 +0000 UTC m=+2594.186455406" watchObservedRunningTime="2026-07-27 19:12:08.061539158 +0000 UTC m=+2594.187393499"
Jul 27 19:12:08.079225 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:08.079017    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" podStartSLOduration=1.078999811 podStartE2EDuration="1.078999811s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:08.077988011 +0000 UTC m=+2594.203842353" watchObservedRunningTime="2026-07-27 19:12:08.078999811 +0000 UTC m=+2594.204854153"
Jul 27 19:12:14.447815 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:14.447777    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:12:16.140228 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.140194    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:12:16.144486 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.144460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.148016 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.147997    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-e1ba46-dockercfg-7zsmf\""
Jul 27 19:12:16.148862 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.148842    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-e1ba46\""
Jul 27 19:12:16.162538 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.162516    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:12:16.185949 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.185923    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:12:16.189341 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.189312    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.206381 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.206358    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:12:16.237896 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.237863    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.237896 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.237911    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxwvl\" (UniqueName: \"kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.238106 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.237944    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.238106 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.238010    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddbnx\" (UniqueName: \"kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.339147 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339116    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddbnx\" (UniqueName: \"kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.339147 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339150    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.339362 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxwvl\" (UniqueName: \"kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.339362 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339210    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.339900 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.339954 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.339910    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.359640 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.359613    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxwvl\" (UniqueName: \"kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl\") pod \"payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.360050 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.360030    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddbnx\" (UniqueName: \"kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx\") pod \"payload-processing-e2e-api-b-e1ba46-586467556d-9fh49\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") " pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.455288 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.455261    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:16.499352 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.499320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:16.609070 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.608934    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:12:16.611766 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:16.611735    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b11b03a_9563_4646_9c46_bb990bbdd443.slice/crio-e5789ff7a23460903e80c607e5f5a1564a48b16cd7e306a3aaba40cc71c7b7db WatchSource:0}: Error finding container e5789ff7a23460903e80c607e5f5a1564a48b16cd7e306a3aaba40cc71c7b7db: Status 404 returned error can't find the container with id e5789ff7a23460903e80c607e5f5a1564a48b16cd7e306a3aaba40cc71c7b7db
Jul 27 19:12:16.659984 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:16.659957    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:12:16.662658 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:16.662632    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaac0fe35_5e7d_4e8d_ad3d_c337fbcf22b8.slice/crio-9f9253420f2f252459f22a4dee7cb5d2c240799040405ee61cc0b5c2db7f1100 WatchSource:0}: Error finding container 9f9253420f2f252459f22a4dee7cb5d2c240799040405ee61cc0b5c2db7f1100: Status 404 returned error can't find the container with id 9f9253420f2f252459f22a4dee7cb5d2c240799040405ee61cc0b5c2db7f1100
Jul 27 19:12:17.084764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.084678    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" event={"ID":"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8","Type":"ContainerStarted","Data":"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"}
Jul 27 19:12:17.084764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.084744    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:17.084999 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.084773    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" event={"ID":"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8","Type":"ContainerStarted","Data":"9f9253420f2f252459f22a4dee7cb5d2c240799040405ee61cc0b5c2db7f1100"}
Jul 27 19:12:17.086256 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.086227    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" event={"ID":"0b11b03a-9563-4646-9c46-bb990bbdd443","Type":"ContainerStarted","Data":"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"}
Jul 27 19:12:17.086465 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.086272    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" event={"ID":"0b11b03a-9563-4646-9c46-bb990bbdd443","Type":"ContainerStarted","Data":"e5789ff7a23460903e80c607e5f5a1564a48b16cd7e306a3aaba40cc71c7b7db"}
Jul 27 19:12:17.086465 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.086373    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:17.111581 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.111531    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" podStartSLOduration=1.111513215 podStartE2EDuration="1.111513215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:17.110909461 +0000 UTC m=+2603.236763805" watchObservedRunningTime="2026-07-27 19:12:17.111513215 +0000 UTC m=+2603.237367558"
Jul 27 19:12:17.147286 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:17.147210    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" podStartSLOduration=1.147192338 podStartE2EDuration="1.147192338s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:12:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:12:17.146358805 +0000 UTC m=+2603.272213158" watchObservedRunningTime="2026-07-27 19:12:17.147192338 +0000 UTC m=+2603.273046684"
Jul 27 19:12:19.050638 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:19.050601    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:19.050976 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:19.050837    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:27.486253 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.486218    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"]
Jul 27 19:12:27.489761 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.489744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:27.498798 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.498780    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:12:27.498986 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.498970    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:12:27.503656 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.503622    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"]
Jul 27 19:12:27.534007 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.533970    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf852f-pld5b\" (UID: \"88684e44-7bbf-4cf2-a3db-19f71714d2d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:27.634726 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.634695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf852f-pld5b\" (UID: \"88684e44-7bbf-4cf2-a3db-19f71714d2d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:27.635315 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.635293    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-bf852f-pld5b\" (UID: \"88684e44-7bbf-4cf2-a3db-19f71714d2d5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:27.799802 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.799713    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:27.942593 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:27.942561    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"]
Jul 27 19:12:27.944403 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:27.944365    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88684e44_7bbf_4cf2_a3db_19f71714d2d5.slice/crio-dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c WatchSource:0}: Error finding container dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c: Status 404 returned error can't find the container with id dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c
Jul 27 19:12:28.094165 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:28.094141    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:12:28.094281 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:28.094205    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:12:28.139351 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:28.139307    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b" event={"ID":"88684e44-7bbf-4cf2-a3db-19f71714d2d5","Type":"ContainerStarted","Data":"dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c"}
Jul 27 19:12:29.144668 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:29.144636    2567 generic.go:356] "Generic (PLEG): container finished" podID="88684e44-7bbf-4cf2-a3db-19f71714d2d5" containerID="b405b49f293ba8e16b2b0b02e896331f6b7949d8344c09ada836b1dce43301a8" exitCode=0
Jul 27 19:12:29.145025 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:29.144729    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b" event={"ID":"88684e44-7bbf-4cf2-a3db-19f71714d2d5","Type":"ContainerDied","Data":"b405b49f293ba8e16b2b0b02e896331f6b7949d8344c09ada836b1dce43301a8"}
Jul 27 19:12:30.278353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:30.278331    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:30.364890 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:30.364854    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca\") pod \"88684e44-7bbf-4cf2-a3db-19f71714d2d5\" (UID: \"88684e44-7bbf-4cf2-a3db-19f71714d2d5\") "
Jul 27 19:12:30.365214 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:30.365192    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "88684e44-7bbf-4cf2-a3db-19f71714d2d5" (UID: "88684e44-7bbf-4cf2-a3db-19f71714d2d5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:30.465920 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:30.465892    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/88684e44-7bbf-4cf2-a3db-19f71714d2d5-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:30.705166 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:30.705131    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:12:31.155112 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:31.155084    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"
Jul 27 19:12:31.155112 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:31.155093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b" event={"ID":"88684e44-7bbf-4cf2-a3db-19f71714d2d5","Type":"ContainerDied","Data":"dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c"}
Jul 27 19:12:31.155322 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:31.155133    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dd487f3bf9f6b6c8f6f2084e67f1e70f57407675719ed5971d16b1e78ce5a10c"
Jul 27 19:12:42.864933 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:42.864902    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:42.865470 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:42.865136    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" podUID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" containerName="payload-processing" containerID="cri-o://e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348" gracePeriod=30
Jul 27 19:12:42.876388 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:42.876338    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:42.877082 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:42.877018    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" podUID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" containerName="payload-pre-processing" containerID="cri-o://466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b" gracePeriod=30
Jul 27 19:12:43.142551 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.142523    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:43.145265 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.145247    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:43.216322 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.216287    2567 generic.go:356] "Generic (PLEG): container finished" podID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" containerID="466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b" exitCode=0
Jul 27 19:12:43.216531 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.216330    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"
Jul 27 19:12:43.216531 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.216333    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" event={"ID":"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d","Type":"ContainerDied","Data":"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"}
Jul 27 19:12:43.216531 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.216388    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc" event={"ID":"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d","Type":"ContainerDied","Data":"db709a145aed5c15c46950ae6ee29d485025ebc8abfceea6121edaa25a61b7a4"}
Jul 27 19:12:43.216531 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.216417    2567 scope.go:117] "RemoveContainer" containerID="466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"
Jul 27 19:12:43.217671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.217652    2567 generic.go:356] "Generic (PLEG): container finished" podID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" containerID="e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348" exitCode=0
Jul 27 19:12:43.217764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.217697    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"
Jul 27 19:12:43.217764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.217715    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" event={"ID":"644bc888-9bb9-4f4e-9056-c9a503dca6e8","Type":"ContainerDied","Data":"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"}
Jul 27 19:12:43.217764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.217742    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx" event={"ID":"644bc888-9bb9-4f4e-9056-c9a503dca6e8","Type":"ContainerDied","Data":"ba6aee2f8695a92066e2a48477bc5db0ca12600f8a18ef0e152383811c5157d2"}
Jul 27 19:12:43.224955 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.224939    2567 scope.go:117] "RemoveContainer" containerID="466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"
Jul 27 19:12:43.225226 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:12:43.225207    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b\": container with ID starting with 466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b not found: ID does not exist" containerID="466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"
Jul 27 19:12:43.225289 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.225233    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b"} err="failed to get container status \"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b\": rpc error: code = NotFound desc = could not find container \"466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b\": container with ID starting with 466f5190ed99c2589bece257b78c6fb4a31257bc250f5ead51fc77f00657e58b not found: ID does not exist"
Jul 27 19:12:43.225289 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.225247    2567 scope.go:117] "RemoveContainer" containerID="e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"
Jul 27 19:12:43.233042 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.233028    2567 scope.go:117] "RemoveContainer" containerID="e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"
Jul 27 19:12:43.233306 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:12:43.233290    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348\": container with ID starting with e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348 not found: ID does not exist" containerID="e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"
Jul 27 19:12:43.233385 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.233312    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348"} err="failed to get container status \"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348\": rpc error: code = NotFound desc = could not find container \"e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348\": container with ID starting with e8c50a45aa20fd224f0e4566d6e9b6286a0c6afe9778bb92b7c6e689611df348 not found: ID does not exist"
Jul 27 19:12:43.281250 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281219    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5kjr\" (UniqueName: \"kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr\") pod \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") "
Jul 27 19:12:43.281404 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281285    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume\") pod \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\" (UID: \"644bc888-9bb9-4f4e-9056-c9a503dca6e8\") "
Jul 27 19:12:43.281404 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281325    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume\") pod \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") "
Jul 27 19:12:43.281404 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281377    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqtbh\" (UniqueName: \"kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh\") pod \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\" (UID: \"527661f0-7f8a-4f7f-9456-ca01bd7a0a1d\") "
Jul 27 19:12:43.281710 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281675    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "644bc888-9bb9-4f4e-9056-c9a503dca6e8" (UID: "644bc888-9bb9-4f4e-9056-c9a503dca6e8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:43.281795 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.281756    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" (UID: "527661f0-7f8a-4f7f-9456-ca01bd7a0a1d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:43.283464 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.283425    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr" (OuterVolumeSpecName: "kube-api-access-z5kjr") pod "644bc888-9bb9-4f4e-9056-c9a503dca6e8" (UID: "644bc888-9bb9-4f4e-9056-c9a503dca6e8"). InnerVolumeSpecName "kube-api-access-z5kjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:43.283689 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.283672    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh" (OuterVolumeSpecName: "kube-api-access-xqtbh") pod "527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" (UID: "527661f0-7f8a-4f7f-9456-ca01bd7a0a1d"). InnerVolumeSpecName "kube-api-access-xqtbh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:12:43.382053 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.381981    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/644bc888-9bb9-4f4e-9056-c9a503dca6e8-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:43.382053 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.382006    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:43.382053 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.382017    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqtbh\" (UniqueName: \"kubernetes.io/projected/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d-kube-api-access-xqtbh\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:43.382053 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.382026    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5kjr\" (UniqueName: \"kubernetes.io/projected/644bc888-9bb9-4f4e-9056-c9a503dca6e8-kube-api-access-z5kjr\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:43.540999 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.540967    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:43.549357 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.549332    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-bf852f-649dbfb948-rsxbc"]
Jul 27 19:12:43.561916 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.561890    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:43.566273 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:43.566248    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-bf852f-69d994f9f4-bndnx"]
Jul 27 19:12:44.382981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:44.382946    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" path="/var/lib/kubelet/pods/527661f0-7f8a-4f7f-9456-ca01bd7a0a1d/volumes"
Jul 27 19:12:44.383349 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:44.383301    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" path="/var/lib/kubelet/pods/644bc888-9bb9-4f4e-9056-c9a503dca6e8/volumes"
Jul 27 19:12:47.004679 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:47.004644    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:12:47.639717 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:47.639671    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"]
Jul 27 19:12:47.644033 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:47.644001    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-bf852f-pld5b"]
Jul 27 19:12:48.381844 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:48.381807    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88684e44-7bbf-4cf2-a3db-19f71714d2d5" path="/var/lib/kubelet/pods/88684e44-7bbf-4cf2-a3db-19f71714d2d5/volumes"
Jul 27 19:12:55.538171 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538134    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"]
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538488    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" containerName="payload-processing"
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538501    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" containerName="payload-processing"
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538513    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" containerName="payload-pre-processing"
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538519    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" containerName="payload-pre-processing"
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538526    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88684e44-7bbf-4cf2-a3db-19f71714d2d5" containerName="revoke-keys"
Jul 27 19:12:55.538571 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538531    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="88684e44-7bbf-4cf2-a3db-19f71714d2d5" containerName="revoke-keys"
Jul 27 19:12:55.538764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538582    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="88684e44-7bbf-4cf2-a3db-19f71714d2d5" containerName="revoke-keys"
Jul 27 19:12:55.538764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538591    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="527661f0-7f8a-4f7f-9456-ca01bd7a0a1d" containerName="payload-pre-processing"
Jul 27 19:12:55.538764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.538599    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="644bc888-9bb9-4f4e-9056-c9a503dca6e8" containerName="payload-processing"
Jul 27 19:12:55.542891 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.542874    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:55.546535 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.546510    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:12:55.546686 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.546517    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:12:55.550170 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.550145    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"]
Jul 27 19:12:55.685270 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.685230    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m\" (UID: \"dca1811b-2d31-4c3d-9322-33541d31738b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:55.785871 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.785840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m\" (UID: \"dca1811b-2d31-4c3d-9322-33541d31738b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:55.786457 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.786427    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m\" (UID: \"dca1811b-2d31-4c3d-9322-33541d31738b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:55.854281 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.854198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:55.987538 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:55.987474    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"]
Jul 27 19:12:55.990243 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:12:55.990218    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddca1811b_2d31_4c3d_9322_33541d31738b.slice/crio-bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4 WatchSource:0}: Error finding container bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4: Status 404 returned error can't find the container with id bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4
Jul 27 19:12:56.284996 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:56.284963    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m" event={"ID":"dca1811b-2d31-4c3d-9322-33541d31738b","Type":"ContainerStarted","Data":"bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4"}
Jul 27 19:12:57.292891 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:57.292858    2567 generic.go:356] "Generic (PLEG): container finished" podID="dca1811b-2d31-4c3d-9322-33541d31738b" containerID="ace27a5f97f25e4ad8615421dc8a158d8425a40d371d2e0f0c327480cab2588e" exitCode=0
Jul 27 19:12:57.293281 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:57.292942    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m" event={"ID":"dca1811b-2d31-4c3d-9322-33541d31738b","Type":"ContainerDied","Data":"ace27a5f97f25e4ad8615421dc8a158d8425a40d371d2e0f0c327480cab2588e"}
Jul 27 19:12:58.426917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:58.426882    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:12:58.609673 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:58.609580    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca\") pod \"dca1811b-2d31-4c3d-9322-33541d31738b\" (UID: \"dca1811b-2d31-4c3d-9322-33541d31738b\") "
Jul 27 19:12:58.609943 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:58.609919    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dca1811b-2d31-4c3d-9322-33541d31738b" (UID: "dca1811b-2d31-4c3d-9322-33541d31738b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:12:58.711162 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:58.711128    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dca1811b-2d31-4c3d-9322-33541d31738b-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:12:59.304381 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:59.304348    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m" event={"ID":"dca1811b-2d31-4c3d-9322-33541d31738b","Type":"ContainerDied","Data":"bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4"}
Jul 27 19:12:59.304577 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:59.304395    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbec7be3b36c6141911c11e9faa921992bf14777c5a9dfe469e644ee22342de4"
Jul 27 19:12:59.304577 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:12:59.304357    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"
Jul 27 19:13:11.371623 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.371576    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:13:11.372467 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.371847    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" podUID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" containerName="payload-processing" containerID="cri-o://dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a" gracePeriod=30
Jul 27 19:13:11.373572 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.373508    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:13:11.373754 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.373717    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" podUID="0b11b03a-9563-4646-9c46-bb990bbdd443" containerName="payload-pre-processing" containerID="cri-o://9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4" gracePeriod=30
Jul 27 19:13:11.636303 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.636281    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:13:11.638806 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.638786    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:13:11.710888 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.710860    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume\") pod \"0b11b03a-9563-4646-9c46-bb990bbdd443\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") "
Jul 27 19:13:11.710888 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.710889    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddbnx\" (UniqueName: \"kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx\") pod \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") "
Jul 27 19:13:11.711111 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.710910    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume\") pod \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\" (UID: \"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8\") "
Jul 27 19:13:11.711111 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.710958    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxwvl\" (UniqueName: \"kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl\") pod \"0b11b03a-9563-4646-9c46-bb990bbdd443\" (UID: \"0b11b03a-9563-4646-9c46-bb990bbdd443\") "
Jul 27 19:13:11.711295 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.711271    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0b11b03a-9563-4646-9c46-bb990bbdd443" (UID: "0b11b03a-9563-4646-9c46-bb990bbdd443"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:11.711367 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.711341    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" (UID: "aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:13:11.713135 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.713111    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx" (OuterVolumeSpecName: "kube-api-access-ddbnx") pod "aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" (UID: "aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8"). InnerVolumeSpecName "kube-api-access-ddbnx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:11.713135 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.713121    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl" (OuterVolumeSpecName: "kube-api-access-mxwvl") pod "0b11b03a-9563-4646-9c46-bb990bbdd443" (UID: "0b11b03a-9563-4646-9c46-bb990bbdd443"). InnerVolumeSpecName "kube-api-access-mxwvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:13:11.812548 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.812514    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0b11b03a-9563-4646-9c46-bb990bbdd443-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:13:11.812548 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.812546    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddbnx\" (UniqueName: \"kubernetes.io/projected/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-kube-api-access-ddbnx\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:13:11.812548 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.812556    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:13:11.812742 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:11.812565    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxwvl\" (UniqueName: \"kubernetes.io/projected/0b11b03a-9563-4646-9c46-bb990bbdd443-kube-api-access-mxwvl\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:13:12.365109 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.365073    2567 generic.go:356] "Generic (PLEG): container finished" podID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" containerID="dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a" exitCode=0
Jul 27 19:13:12.365312 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.365115    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"
Jul 27 19:13:12.365312 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.365154    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" event={"ID":"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8","Type":"ContainerDied","Data":"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"}
Jul 27 19:13:12.365312 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.365209    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49" event={"ID":"aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8","Type":"ContainerDied","Data":"9f9253420f2f252459f22a4dee7cb5d2c240799040405ee61cc0b5c2db7f1100"}
Jul 27 19:13:12.365312 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.365234    2567 scope.go:117] "RemoveContainer" containerID="dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"
Jul 27 19:13:12.366805 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.366763    2567 generic.go:356] "Generic (PLEG): container finished" podID="0b11b03a-9563-4646-9c46-bb990bbdd443" containerID="9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4" exitCode=0
Jul 27 19:13:12.366917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.366807    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"
Jul 27 19:13:12.366917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.366827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" event={"ID":"0b11b03a-9563-4646-9c46-bb990bbdd443","Type":"ContainerDied","Data":"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"}
Jul 27 19:13:12.366917 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.366857    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6" event={"ID":"0b11b03a-9563-4646-9c46-bb990bbdd443","Type":"ContainerDied","Data":"e5789ff7a23460903e80c607e5f5a1564a48b16cd7e306a3aaba40cc71c7b7db"}
Jul 27 19:13:12.375362 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.375114    2567 scope.go:117] "RemoveContainer" containerID="dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"
Jul 27 19:13:12.375704 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:13:12.375549    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a\": container with ID starting with dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a not found: ID does not exist" containerID="dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"
Jul 27 19:13:12.375704 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.375577    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a"} err="failed to get container status \"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a\": rpc error: code = NotFound desc = could not find container \"dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a\": container with ID starting with dee1da7e6059c9ed5e2bbdf52cbf4ac3fbd52d3e51ba532ff9b5ea53553eac4a not found: ID does not exist"
Jul 27 19:13:12.375704 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.375595    2567 scope.go:117] "RemoveContainer" containerID="9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"
Jul 27 19:13:12.384416 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.384397    2567 scope.go:117] "RemoveContainer" containerID="9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"
Jul 27 19:13:12.384712 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:13:12.384686    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4\": container with ID starting with 9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4 not found: ID does not exist" containerID="9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"
Jul 27 19:13:12.384799 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.384723    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4"} err="failed to get container status \"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4\": rpc error: code = NotFound desc = could not find container \"9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4\": container with ID starting with 9bc1df6349d785c4fb71a2d2fba9fb3067ec23144d5b43007a3d16649d0d8cd4 not found: ID does not exist"
Jul 27 19:13:12.394714 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.394690    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:13:12.401883 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.401860    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-e1ba46-86c4678ccb-rrwr6"]
Jul 27 19:13:12.418604 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.418576    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:13:12.425847 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:12.425821    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-e1ba46-586467556d-9fh49"]
Jul 27 19:13:14.381940 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:14.381907    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b11b03a-9563-4646-9c46-bb990bbdd443" path="/var/lib/kubelet/pods/0b11b03a-9563-4646-9c46-bb990bbdd443/volumes"
Jul 27 19:13:14.382485 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:14.382392    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" path="/var/lib/kubelet/pods/aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8/volumes"
Jul 27 19:13:15.635421 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:15.635377    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"]
Jul 27 19:13:15.641100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:15.641074    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-e1ba46-bn92m"]
Jul 27 19:13:16.388428 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:16.388387    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dca1811b-2d31-4c3d-9322-33541d31738b" path="/var/lib/kubelet/pods/dca1811b-2d31-4c3d-9322-33541d31738b/volumes"
Jul 27 19:13:16.388691 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:16.388677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:13:28.836392 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836355    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836696    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b11b03a-9563-4646-9c46-bb990bbdd443" containerName="payload-pre-processing"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836709    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b11b03a-9563-4646-9c46-bb990bbdd443" containerName="payload-pre-processing"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836729    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dca1811b-2d31-4c3d-9322-33541d31738b" containerName="revoke-keys"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836735    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="dca1811b-2d31-4c3d-9322-33541d31738b" containerName="revoke-keys"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836746    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" containerName="payload-processing"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836751    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" containerName="payload-processing"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836795    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="dca1811b-2d31-4c3d-9322-33541d31738b" containerName="revoke-keys"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836801    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="aac0fe35-5e7d-4e8d-ad3d-c337fbcf22b8" containerName="payload-processing"
Jul 27 19:13:28.836834 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.836810    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b11b03a-9563-4646-9c46-bb990bbdd443" containerName="payload-pre-processing"
Jul 27 19:13:28.841242 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.841218    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:28.845100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.845066    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-7f7473\""
Jul 27 19:13:28.845227 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.845101    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-7f7473-dockercfg-j829s\""
Jul 27 19:13:28.859096 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.859070    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:13:28.956032 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.955999    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:28.956232 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:28.956064    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8b7d\" (UniqueName: \"kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.014982 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.014948    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:13:29.018273 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.018257    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.040240 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.040211    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:13:29.056605 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.056581    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.056760 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.056664    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8b7d\" (UniqueName: \"kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.057252 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.057233    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.070657 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.070633    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8b7d\" (UniqueName: \"kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d\") pod \"payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.152662 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.152580    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.157909 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.157886    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.157999 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.157946    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjm9d\" (UniqueName: \"kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.259164 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.259128    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.259339 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.259212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjm9d\" (UniqueName: \"kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.260308 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.260284    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.275751 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.275720    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjm9d\" (UniqueName: \"kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d\") pod \"payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") " pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.308495 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.308472    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:13:29.311069 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:13:29.311043    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3428061_8f54_4fa2_bb4b_ef3ad91ec3cf.slice/crio-fe3a810d6687d6d8bac1b6ece4cd76cc333b29c0b77f6eb297c26ae6c7615611 WatchSource:0}: Error finding container fe3a810d6687d6d8bac1b6ece4cd76cc333b29c0b77f6eb297c26ae6c7615611: Status 404 returned error can't find the container with id fe3a810d6687d6d8bac1b6ece4cd76cc333b29c0b77f6eb297c26ae6c7615611
Jul 27 19:13:29.328009 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.327986    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:29.449312 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.449269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" event={"ID":"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf","Type":"ContainerStarted","Data":"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"}
Jul 27 19:13:29.449520 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.449334    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" event={"ID":"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf","Type":"ContainerStarted","Data":"fe3a810d6687d6d8bac1b6ece4cd76cc333b29c0b77f6eb297c26ae6c7615611"}
Jul 27 19:13:29.449520 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.449367    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:29.478674 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.478645    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:13:29.481131 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:13:29.481104    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod452adebd_e0ad_4c23_92e5_0d1c232e1902.slice/crio-4919f7358e75b40e83b38db21169f178de89e6c3b91ec2def1e1a9f811f2ba10 WatchSource:0}: Error finding container 4919f7358e75b40e83b38db21169f178de89e6c3b91ec2def1e1a9f811f2ba10: Status 404 returned error can't find the container with id 4919f7358e75b40e83b38db21169f178de89e6c3b91ec2def1e1a9f811f2ba10
Jul 27 19:13:29.489235 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:29.489185    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" podStartSLOduration=1.489167328 podStartE2EDuration="1.489167328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:29.486588506 +0000 UTC m=+2675.612442848" watchObservedRunningTime="2026-07-27 19:13:29.489167328 +0000 UTC m=+2675.615021672"
Jul 27 19:13:30.455467 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:30.455399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" event={"ID":"452adebd-e0ad-4c23-92e5-0d1c232e1902","Type":"ContainerStarted","Data":"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"}
Jul 27 19:13:30.455960 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:30.455654    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:30.455960 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:30.455701    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" event={"ID":"452adebd-e0ad-4c23-92e5-0d1c232e1902","Type":"ContainerStarted","Data":"4919f7358e75b40e83b38db21169f178de89e6c3b91ec2def1e1a9f811f2ba10"}
Jul 27 19:13:30.481208 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:30.481155    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" podStartSLOduration=2.481140726 podStartE2EDuration="2.481140726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:30.481138711 +0000 UTC m=+2676.606993058" watchObservedRunningTime="2026-07-27 19:13:30.481140726 +0000 UTC m=+2676.606995068"
Jul 27 19:13:34.339072 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:34.339032    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:13:37.692791 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.692752    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:13:37.696057 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.696039    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.703481 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.703464    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-6710a9-dockercfg-jclq5\""
Jul 27 19:13:37.703875 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.703861    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-6710a9\""
Jul 27 19:13:37.727945 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.727922    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:13:37.840778 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.840745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.840778 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.840781    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlz7f\" (UniqueName: \"kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.889351 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.889316    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:13:37.892602 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.892587    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:37.920810 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.920779    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:13:37.941809 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.941771    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.941809 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.941808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlz7f\" (UniqueName: \"kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.942652 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.942624    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:37.959839 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:37.959767    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlz7f\" (UniqueName: \"kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f\") pod \"payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:38.006659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.006570    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:38.042886 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.042854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rswfj\" (UniqueName: \"kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.043043 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.042914    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.144177 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.144144    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rswfj\" (UniqueName: \"kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.144369 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.144212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.144901 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.144880    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.195405 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.195356    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:13:38.198587 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.198566    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rswfj\" (UniqueName: \"kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj\") pod \"payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") " pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.200754 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:13:38.200728    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88b3b24f_6bd1_4a40_b2bc_fdd9c9dc10e9.slice/crio-6ed4261b95c73e078a8f0f40b85f5c223cc411da93f9d7d546dea6c38b5f652c WatchSource:0}: Error finding container 6ed4261b95c73e078a8f0f40b85f5c223cc411da93f9d7d546dea6c38b5f652c: Status 404 returned error can't find the container with id 6ed4261b95c73e078a8f0f40b85f5c223cc411da93f9d7d546dea6c38b5f652c
Jul 27 19:13:38.202051 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.202018    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.386758 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.386579    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:13:38.389402 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:13:38.389378    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccc69f3d_7fd2_4aea_8976_8c3076d1f1e2.slice/crio-8f54ed9317c34c4eb24537abce67f1e0950769244b9e4e902d71f98e28329c35 WatchSource:0}: Error finding container 8f54ed9317c34c4eb24537abce67f1e0950769244b9e4e902d71f98e28329c35: Status 404 returned error can't find the container with id 8f54ed9317c34c4eb24537abce67f1e0950769244b9e4e902d71f98e28329c35
Jul 27 19:13:38.501907 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.501795    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" event={"ID":"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2","Type":"ContainerStarted","Data":"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"}
Jul 27 19:13:38.501907 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.501868    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:38.501907 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.501893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" event={"ID":"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2","Type":"ContainerStarted","Data":"8f54ed9317c34c4eb24537abce67f1e0950769244b9e4e902d71f98e28329c35"}
Jul 27 19:13:38.503381 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.503349    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" event={"ID":"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9","Type":"ContainerStarted","Data":"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"}
Jul 27 19:13:38.503526 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.503403    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" event={"ID":"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9","Type":"ContainerStarted","Data":"6ed4261b95c73e078a8f0f40b85f5c223cc411da93f9d7d546dea6c38b5f652c"}
Jul 27 19:13:38.503526 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.503471    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:38.573638 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:38.573576    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" podStartSLOduration=1.573558222 podStartE2EDuration="1.573558222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:38.562546996 +0000 UTC m=+2684.688401338" watchObservedRunningTime="2026-07-27 19:13:38.573558222 +0000 UTC m=+2684.699412542"
Jul 27 19:13:40.457934 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:40.457904    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:13:40.512399 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:40.512348    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" podStartSLOduration=3.512331586 podStartE2EDuration="3.512331586s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:13:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:13:38.603887163 +0000 UTC m=+2684.729741505" watchObservedRunningTime="2026-07-27 19:13:40.512331586 +0000 UTC m=+2686.638185957"
Jul 27 19:13:41.463924 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:41.463895    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:13:49.510096 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:49.510004    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:13:49.510569 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:49.510120    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:13:49.536897 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:49.536869    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:13:54.647543 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:13:54.647508    2567 scope.go:117] "RemoveContainer" containerID="c5618962aec2137335e07dc892e3262413a59e851d5762e75dbf39429c58c77e"
Jul 27 19:14:00.314767 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:14:00.314733    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:14:37.301629 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:14:37.301591    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:15:01.705846 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:15:01.705815    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:15:26.101227 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:15:26.101137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:15:44.715321 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:15:44.715287    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:16:06.840575 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:16:06.840526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:16:25.401563 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:16:25.401526    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:16:46.097427 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:16:46.097335    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:17:04.524781 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:17:04.524747    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:17:27.786005 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:17:27.785963    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:17:44.906037 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:17:44.905999    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:17:54.693621 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:17:54.693592    2567 scope.go:117] "RemoveContainer" containerID="e0ccf12746c52187f3ecb9d6ca61a8e9e39d4bfe441b55ec2817a0b3dd380a98"
Jul 27 19:17:54.701285 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:17:54.701267    2567 scope.go:117] "RemoveContainer" containerID="7cf24981cb630b35b6adf4951bc8d062cc02411458976a05e2ce5860901a1e03"
Jul 27 19:18:07.776525 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:18:07.776493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:18:26.042047 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:18:26.041969    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:18:53.860306 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:18:53.860264    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:18:54.721386 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:18:54.721353    2567 scope.go:117] "RemoveContainer" containerID="b405b49f293ba8e16b2b0b02e896331f6b7949d8344c09ada836b1dce43301a8"
Jul 27 19:19:11.724423 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:19:11.724384    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:19:20.838936 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:19:20.838893    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:19:54.294538 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:19:54.294469    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:19:54.740114 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:19:54.740091    2567 scope.go:117] "RemoveContainer" containerID="ace27a5f97f25e4ad8615421dc8a158d8425a40d371d2e0f0c327480cab2588e"
Jul 27 19:20:40.653831 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:20:40.653798    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:20:59.552213 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:20:59.552175    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:21:21.596433 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:21.596347    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:21:41.308852 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:41.308811    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:21:56.023169 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.023136    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:21:56.026413 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.026397    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:21:56.029616 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.029580    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-8kmxg\""
Jul 27 19:21:56.039404 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.039380    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:21:56.134497 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.134460    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb95c\" (UniqueName: \"kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c\") pod \"kuadrant-operator-catalog-hwfq7\" (UID: \"1360f320-51bf-4061-b33c-6438bca6526b\") " pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:21:56.235233 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.235191    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb95c\" (UniqueName: \"kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c\") pod \"kuadrant-operator-catalog-hwfq7\" (UID: \"1360f320-51bf-4061-b33c-6438bca6526b\") " pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:21:56.247007 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.246980    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb95c\" (UniqueName: \"kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c\") pod \"kuadrant-operator-catalog-hwfq7\" (UID: \"1360f320-51bf-4061-b33c-6438bca6526b\") " pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:21:56.335988 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.335920    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:21:56.470436 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.470409    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:21:56.476382 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.476359    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 27 19:21:56.715651 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:56.715619    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" event={"ID":"1360f320-51bf-4061-b33c-6438bca6526b","Type":"ContainerStarted","Data":"20b9d18bf23ae3b4bf35b1dba5f7696bc70559cd74dcd87972de00687a49362e"}
Jul 27 19:21:59.730996 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:59.730956    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" event={"ID":"1360f320-51bf-4061-b33c-6438bca6526b","Type":"ContainerStarted","Data":"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"}
Jul 27 19:21:59.760832 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:21:59.760780    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" podStartSLOduration=2.403189554 podStartE2EDuration="4.760764854s" totalImagesPullingTime="2.3575753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:21:59.758977569 +0000 UTC m=+3185.884831912" watchObservedRunningTime="2026-07-27 19:21:59.760764854 +0000 UTC m=+3185.886619243"
Jul 27 19:22:06.059606 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.059567    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:22:06.336666 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.336576    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:06.336666 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.336644    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:06.358940 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.358914    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:06.781777 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.781749    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:06.833564 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:06.833534    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:22:08.770433 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:08.770378    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" podUID="1360f320-51bf-4061-b33c-6438bca6526b" containerName="registry-server" containerID="cri-o://b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f" gracePeriod=2
Jul 27 19:22:09.022452 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.022380    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:09.030923 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.030902    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb95c\" (UniqueName: \"kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c\") pod \"1360f320-51bf-4061-b33c-6438bca6526b\" (UID: \"1360f320-51bf-4061-b33c-6438bca6526b\") "
Jul 27 19:22:09.033036 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.033013    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c" (OuterVolumeSpecName: "kube-api-access-cb95c") pod "1360f320-51bf-4061-b33c-6438bca6526b" (UID: "1360f320-51bf-4061-b33c-6438bca6526b"). InnerVolumeSpecName "kube-api-access-cb95c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:22:09.132172 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.132149    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb95c\" (UniqueName: \"kubernetes.io/projected/1360f320-51bf-4061-b33c-6438bca6526b-kube-api-access-cb95c\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:22:09.775036 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.775003    2567 generic.go:356] "Generic (PLEG): container finished" podID="1360f320-51bf-4061-b33c-6438bca6526b" containerID="b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f" exitCode=0
Jul 27 19:22:09.775502 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.775044    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7"
Jul 27 19:22:09.775502 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.775089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" event={"ID":"1360f320-51bf-4061-b33c-6438bca6526b","Type":"ContainerDied","Data":"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"}
Jul 27 19:22:09.775502 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.775145    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hwfq7" event={"ID":"1360f320-51bf-4061-b33c-6438bca6526b","Type":"ContainerDied","Data":"20b9d18bf23ae3b4bf35b1dba5f7696bc70559cd74dcd87972de00687a49362e"}
Jul 27 19:22:09.775502 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.775177    2567 scope.go:117] "RemoveContainer" containerID="b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"
Jul 27 19:22:09.784602 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.784586    2567 scope.go:117] "RemoveContainer" containerID="b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"
Jul 27 19:22:09.784862 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:22:09.784843    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f\": container with ID starting with b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f not found: ID does not exist" containerID="b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"
Jul 27 19:22:09.784918 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.784871    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f"} err="failed to get container status \"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f\": rpc error: code = NotFound desc = could not find container \"b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f\": container with ID starting with b501ac4ab2a3526f123b90e9bfb2e6ee3c6bb188a3d92eea6ebe705ddb25c93f not found: ID does not exist"
Jul 27 19:22:09.801377 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.801342    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:22:09.808774 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:09.808754    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hwfq7"]
Jul 27 19:22:10.382103 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:10.382074    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1360f320-51bf-4061-b33c-6438bca6526b" path="/var/lib/kubelet/pods/1360f320-51bf-4061-b33c-6438bca6526b/volumes"
Jul 27 19:22:37.801692 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:37.801657    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:22:52.744670 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:22:52.744592    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:23:11.092226 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:11.092188    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:23:25.996403 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:25.996368    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:23:41.147135 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.147096    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:23:41.147572 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.147427    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1360f320-51bf-4061-b33c-6438bca6526b" containerName="registry-server"
Jul 27 19:23:41.147572 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.147454    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="1360f320-51bf-4061-b33c-6438bca6526b" containerName="registry-server"
Jul 27 19:23:41.147572 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.147538    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="1360f320-51bf-4061-b33c-6438bca6526b" containerName="registry-server"
Jul 27 19:23:41.150388 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.150373    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.153210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.153192    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-1d1107\""
Jul 27 19:23:41.166879 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.166853    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:23:41.171490 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.171467    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:23:41.175116 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.175097    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.178295 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.178275    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-1d1107-dockercfg-gv557\""
Jul 27 19:23:41.188039 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.188015    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:23:41.328117 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.328079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n62k4\" (UniqueName: \"kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.328288 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.328122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.328288 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.328160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxfj2\" (UniqueName: \"kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.328288 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.328193    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.429180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxfj2\" (UniqueName: \"kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.429180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.429394 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429296    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n62k4\" (UniqueName: \"kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.429394 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429319    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.429912 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429895    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.429993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.429978    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.443071 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.443041    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxfj2\" (UniqueName: \"kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2\") pod \"payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.443193 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.443090    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n62k4\" (UniqueName: \"kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4\") pod \"payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.460584 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.460564    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:41.488809 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.488782    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:41.619319 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.619277    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:23:41.621161 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:23:41.621134    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64109afc_fa76_43b5_9097_5821990e7a9e.slice/crio-43ad0409d37da803efd8c04742435addd7487af0593f45db5ff7b9454f72af24 WatchSource:0}: Error finding container 43ad0409d37da803efd8c04742435addd7487af0593f45db5ff7b9454f72af24: Status 404 returned error can't find the container with id 43ad0409d37da803efd8c04742435addd7487af0593f45db5ff7b9454f72af24
Jul 27 19:23:41.642840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:41.642811    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:23:41.653630 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:23:41.653598    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd380db62_1d44_4135_a3d6_1159464a426b.slice/crio-988b4ba89233c12156f79ac071dff31f5a83b407634b7aa634617992fff708bc WatchSource:0}: Error finding container 988b4ba89233c12156f79ac071dff31f5a83b407634b7aa634617992fff708bc: Status 404 returned error can't find the container with id 988b4ba89233c12156f79ac071dff31f5a83b407634b7aa634617992fff708bc
Jul 27 19:23:42.182726 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.182661    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" event={"ID":"64109afc-fa76-43b5-9097-5821990e7a9e","Type":"ContainerStarted","Data":"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"}
Jul 27 19:23:42.183218 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.182876    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:23:42.183218 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.182938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" event={"ID":"64109afc-fa76-43b5-9097-5821990e7a9e","Type":"ContainerStarted","Data":"43ad0409d37da803efd8c04742435addd7487af0593f45db5ff7b9454f72af24"}
Jul 27 19:23:42.184211 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.184182    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" event={"ID":"d380db62-1d44-4135-a3d6-1159464a426b","Type":"ContainerStarted","Data":"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"}
Jul 27 19:23:42.184355 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.184237    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:42.184355 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.184260    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" event={"ID":"d380db62-1d44-4135-a3d6-1159464a426b","Type":"ContainerStarted","Data":"988b4ba89233c12156f79ac071dff31f5a83b407634b7aa634617992fff708bc"}
Jul 27 19:23:42.215285 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.215229    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" podStartSLOduration=1.215210969 podStartE2EDuration="1.215210969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:42.213528681 +0000 UTC m=+3288.339383025" watchObservedRunningTime="2026-07-27 19:23:42.215210969 +0000 UTC m=+3288.341065313"
Jul 27 19:23:42.250121 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:42.250066    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" podStartSLOduration=1.250051166 podStartE2EDuration="1.250051166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:23:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:23:42.247900018 +0000 UTC m=+3288.373754362" watchObservedRunningTime="2026-07-27 19:23:42.250051166 +0000 UTC m=+3288.375905557"
Jul 27 19:23:48.311503 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:48.311465    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:23:53.192279 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:53.192251    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:23:53.192718 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:23:53.192357    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:24:01.192085 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.192056    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:24:01.196468 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.196433    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.199725 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.199692    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-0bd532\""
Jul 27 19:24:01.199850 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.199730    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-0bd532-dockercfg-snn96\""
Jul 27 19:24:01.210784 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.210758    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:24:01.265809 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.265771    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:24:01.269778 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.269753    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.284049 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.284024    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:24:01.297639 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.297610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.297786 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.297650    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fmcl\" (UniqueName: \"kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.398981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.398942    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.398981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.398980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtc4d\" (UniqueName: \"kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.399221 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.399002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.399221 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.399031    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fmcl\" (UniqueName: \"kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.399806 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.399785    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.408031 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.407996    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fmcl\" (UniqueName: \"kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl\") pod \"payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.500185 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.500102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.500185 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.500136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtc4d\" (UniqueName: \"kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.500796 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.500777    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.506909 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.506881    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:01.509386 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.509358    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtc4d\" (UniqueName: \"kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d\") pod \"payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.581946 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.581915    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:01.652860 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.652812    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:24:01.658747 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:24:01.658714    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d62d23_61d5_45bb_9510_596badcebe78.slice/crio-7a3f42a57252d27be9b465d2a4960e2b402a5748c338321faaa0edc0c672f056 WatchSource:0}: Error finding container 7a3f42a57252d27be9b465d2a4960e2b402a5748c338321faaa0edc0c672f056: Status 404 returned error can't find the container with id 7a3f42a57252d27be9b465d2a4960e2b402a5748c338321faaa0edc0c672f056
Jul 27 19:24:01.739501 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:01.739472    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:24:01.741269 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:24:01.741247    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15c14f3_d4a5_4174_911f_ca3a75f23be3.slice/crio-af90de60fdec9ac49fb952acff0ee672d433c9c1eba77be20cf358c023e9dcb9 WatchSource:0}: Error finding container af90de60fdec9ac49fb952acff0ee672d433c9c1eba77be20cf358c023e9dcb9: Status 404 returned error can't find the container with id af90de60fdec9ac49fb952acff0ee672d433c9c1eba77be20cf358c023e9dcb9
Jul 27 19:24:02.287325 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.287277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" event={"ID":"f15c14f3-d4a5-4174-911f-ca3a75f23be3","Type":"ContainerStarted","Data":"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"}
Jul 27 19:24:02.287860 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.287354    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" event={"ID":"f15c14f3-d4a5-4174-911f-ca3a75f23be3","Type":"ContainerStarted","Data":"af90de60fdec9ac49fb952acff0ee672d433c9c1eba77be20cf358c023e9dcb9"}
Jul 27 19:24:02.289147 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.289113    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" event={"ID":"54d62d23-61d5-45bb-9510-596badcebe78","Type":"ContainerStarted","Data":"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"}
Jul 27 19:24:02.289276 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.289169    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" event={"ID":"54d62d23-61d5-45bb-9510-596badcebe78","Type":"ContainerStarted","Data":"7a3f42a57252d27be9b465d2a4960e2b402a5748c338321faaa0edc0c672f056"}
Jul 27 19:24:02.289276 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.289208    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:02.289474 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.289392    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:02.311342 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.311296    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" podStartSLOduration=1.311280638 podStartE2EDuration="1.311280638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:02.309662959 +0000 UTC m=+3308.435517540" watchObservedRunningTime="2026-07-27 19:24:02.311280638 +0000 UTC m=+3308.437134979"
Jul 27 19:24:02.330702 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:02.330654    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" podStartSLOduration=1.330639724 podStartE2EDuration="1.330639724s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:24:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:24:02.329003459 +0000 UTC m=+3308.454857804" watchObservedRunningTime="2026-07-27 19:24:02.330639724 +0000 UTC m=+3308.456494066"
Jul 27 19:24:08.297488 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:08.297452    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:24:13.296432 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:13.296400    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:24:13.296861 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:13.296594    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:24:20.447835 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:20.447758    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc_f15c14f3-d4a5-4174-911f-ca3a75f23be3/payload-processing/0.log"
Jul 27 19:24:32.392045 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:24:32.392015    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:25:32.093661 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:32.093626    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:25:44.219811 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:44.219782    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z_d380db62-1d44-4135-a3d6-1159464a426b/payload-processing/0.log"
Jul 27 19:25:44.575965 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:44.575887    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc_f15c14f3-d4a5-4174-911f-ca3a75f23be3/payload-processing/0.log"
Jul 27 19:25:50.953596 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.953555    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:25:50.956916 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.956896    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:25:50.957029 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.957008    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:50.960143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.960111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:50.960270 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.960249    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-fa6952\""
Jul 27 19:25:50.972952 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.972929    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:25:50.975118 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:50.975095    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:25:51.039513 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.039477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqk7x\" (UniqueName: \"kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.039703 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.039519    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.039703 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.039567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5ssw\" (UniqueName: \"kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.039703 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.039678    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.140491 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.140428    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.140685 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.140544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqk7x\" (UniqueName: \"kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.140685 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.140566    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.140685 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.140590    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5ssw\" (UniqueName: \"kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.141131 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.141113    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.141220 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.141203    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.150740 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.150709    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5ssw\" (UniqueName: \"kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw\") pod \"payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.150910 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.150711    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqk7x\" (UniqueName: \"kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x\") pod \"payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.269320 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.269233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.277267 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.277243    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.424216 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.424189    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:25:51.426744 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:25:51.426713    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode632bf51_4c21_4146_a3e2_ad7b9075428c.slice/crio-a3ba26ebb4213691b0b16de6dbe3560fa8e7a75c0906d1cb508b42cad4a01050 WatchSource:0}: Error finding container a3ba26ebb4213691b0b16de6dbe3560fa8e7a75c0906d1cb508b42cad4a01050: Status 404 returned error can't find the container with id a3ba26ebb4213691b0b16de6dbe3560fa8e7a75c0906d1cb508b42cad4a01050
Jul 27 19:25:51.653906 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.653832    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:25:51.657414 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:25:51.657382    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9830f02e_e903_43dc_9b5c_ac8dadf18865.slice/crio-fd6f95ca16587cba8df3c8b08a2da2c63e519909ba94fa10aed690c82f2b15bf WatchSource:0}: Error finding container fd6f95ca16587cba8df3c8b08a2da2c63e519909ba94fa10aed690c82f2b15bf: Status 404 returned error can't find the container with id fd6f95ca16587cba8df3c8b08a2da2c63e519909ba94fa10aed690c82f2b15bf
Jul 27 19:25:51.784507 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.784472    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" event={"ID":"9830f02e-e903-43dc-9b5c-ac8dadf18865","Type":"ContainerStarted","Data":"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"}
Jul 27 19:25:51.784682 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.784531    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" event={"ID":"9830f02e-e903-43dc-9b5c-ac8dadf18865","Type":"ContainerStarted","Data":"fd6f95ca16587cba8df3c8b08a2da2c63e519909ba94fa10aed690c82f2b15bf"}
Jul 27 19:25:51.784682 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.784586    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:25:51.786211 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.786190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" event={"ID":"e632bf51-4c21-4146-a3e2-ad7b9075428c","Type":"ContainerStarted","Data":"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"}
Jul 27 19:25:51.786326 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.786229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" event={"ID":"e632bf51-4c21-4146-a3e2-ad7b9075428c","Type":"ContainerStarted","Data":"a3ba26ebb4213691b0b16de6dbe3560fa8e7a75c0906d1cb508b42cad4a01050"}
Jul 27 19:25:51.786326 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.786256    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:25:51.807663 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.807621    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" podStartSLOduration=1.807609485 podStartE2EDuration="1.807609485s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:51.807175414 +0000 UTC m=+3417.933029756" watchObservedRunningTime="2026-07-27 19:25:51.807609485 +0000 UTC m=+3417.933463826"
Jul 27 19:25:51.829322 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:25:51.829267    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" podStartSLOduration=1.829254464 podStartE2EDuration="1.829254464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:25:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:25:51.828251128 +0000 UTC m=+3417.954105471" watchObservedRunningTime="2026-07-27 19:25:51.829254464 +0000 UTC m=+3417.955108805"
Jul 27 19:26:00.393471 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:00.393424    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:26:02.793838 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:02.793806    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:26:02.794314 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:02.793879    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:26:04.509287 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.509248    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"]
Jul 27 19:26:04.515599 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.514216    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:04.517764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.517742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:26:04.517884 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.517784    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:26:04.521706 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.521682    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"]
Jul 27 19:26:04.650323 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.650294    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68\" (UID: \"2fa7deb2-02de-4e39-8eee-b841e9006946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:04.751468 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.751421    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68\" (UID: \"2fa7deb2-02de-4e39-8eee-b841e9006946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:04.751975 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.751956    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68\" (UID: \"2fa7deb2-02de-4e39-8eee-b841e9006946\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:04.828611 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.828558    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:04.972483 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:04.972459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"]
Jul 27 19:26:04.974124 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:26:04.974098    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fa7deb2_02de_4e39_8eee_b841e9006946.slice/crio-7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c WatchSource:0}: Error finding container 7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c: Status 404 returned error can't find the container with id 7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c
Jul 27 19:26:05.851744 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:05.851712    2567 generic.go:356] "Generic (PLEG): container finished" podID="2fa7deb2-02de-4e39-8eee-b841e9006946" containerID="8c1a304073bcdeb45cc7c62af35ea50fbd12e74b3adcd7b497e795a59d0b84fe" exitCode=0
Jul 27 19:26:05.852077 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:05.851780    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68" event={"ID":"2fa7deb2-02de-4e39-8eee-b841e9006946","Type":"ContainerDied","Data":"8c1a304073bcdeb45cc7c62af35ea50fbd12e74b3adcd7b497e795a59d0b84fe"}
Jul 27 19:26:05.852077 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:05.851829    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68" event={"ID":"2fa7deb2-02de-4e39-8eee-b841e9006946","Type":"ContainerStarted","Data":"7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c"}
Jul 27 19:26:06.987241 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:06.987219    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:07.068133 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.068107    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca\") pod \"2fa7deb2-02de-4e39-8eee-b841e9006946\" (UID: \"2fa7deb2-02de-4e39-8eee-b841e9006946\") "
Jul 27 19:26:07.068476 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.068456    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2fa7deb2-02de-4e39-8eee-b841e9006946" (UID: "2fa7deb2-02de-4e39-8eee-b841e9006946"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:07.168746 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.168692    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2fa7deb2-02de-4e39-8eee-b841e9006946-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:07.861913 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.861887    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"
Jul 27 19:26:07.862092 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.861893    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68" event={"ID":"2fa7deb2-02de-4e39-8eee-b841e9006946","Type":"ContainerDied","Data":"7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c"}
Jul 27 19:26:07.862092 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:07.861994    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ab9db23764a218f6924f1de39340f78faed5291be27042d326e6dba7723aa9c"
Jul 27 19:26:15.947880 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:15.947845    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:26:15.948332 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:15.948054    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" podUID="e632bf51-4c21-4146-a3e2-ad7b9075428c" containerName="payload-processing" containerID="cri-o://4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d" gracePeriod=30
Jul 27 19:26:15.953831 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:15.953805    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:26:15.954104 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:15.954070    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" podUID="9830f02e-e903-43dc-9b5c-ac8dadf18865" containerName="payload-pre-processing" containerID="cri-o://9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001" gracePeriod=30
Jul 27 19:26:16.256384 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.256363    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:26:16.262319 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.262279    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:26:16.336847 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.336820    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lqk7x\" (UniqueName: \"kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x\") pod \"9830f02e-e903-43dc-9b5c-ac8dadf18865\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") "
Jul 27 19:26:16.336993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.336894    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5ssw\" (UniqueName: \"kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw\") pod \"e632bf51-4c21-4146-a3e2-ad7b9075428c\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") "
Jul 27 19:26:16.336993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.336941    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume\") pod \"e632bf51-4c21-4146-a3e2-ad7b9075428c\" (UID: \"e632bf51-4c21-4146-a3e2-ad7b9075428c\") "
Jul 27 19:26:16.336993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.336985    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume\") pod \"9830f02e-e903-43dc-9b5c-ac8dadf18865\" (UID: \"9830f02e-e903-43dc-9b5c-ac8dadf18865\") "
Jul 27 19:26:16.337370 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.337345    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e632bf51-4c21-4146-a3e2-ad7b9075428c" (UID: "e632bf51-4c21-4146-a3e2-ad7b9075428c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:16.337478 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.337457    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9830f02e-e903-43dc-9b5c-ac8dadf18865" (UID: "9830f02e-e903-43dc-9b5c-ac8dadf18865"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:16.339095 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.339066    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x" (OuterVolumeSpecName: "kube-api-access-lqk7x") pod "9830f02e-e903-43dc-9b5c-ac8dadf18865" (UID: "9830f02e-e903-43dc-9b5c-ac8dadf18865"). InnerVolumeSpecName "kube-api-access-lqk7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:26:16.339198 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.339156    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw" (OuterVolumeSpecName: "kube-api-access-s5ssw") pod "e632bf51-4c21-4146-a3e2-ad7b9075428c" (UID: "e632bf51-4c21-4146-a3e2-ad7b9075428c"). InnerVolumeSpecName "kube-api-access-s5ssw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:26:16.437633 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.437596    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e632bf51-4c21-4146-a3e2-ad7b9075428c-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:16.437633 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.437625    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9830f02e-e903-43dc-9b5c-ac8dadf18865-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:16.437811 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.437640    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lqk7x\" (UniqueName: \"kubernetes.io/projected/9830f02e-e903-43dc-9b5c-ac8dadf18865-kube-api-access-lqk7x\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:16.437811 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.437655    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5ssw\" (UniqueName: \"kubernetes.io/projected/e632bf51-4c21-4146-a3e2-ad7b9075428c-kube-api-access-s5ssw\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:16.908613 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.908586    2567 generic.go:356] "Generic (PLEG): container finished" podID="9830f02e-e903-43dc-9b5c-ac8dadf18865" containerID="9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001" exitCode=0
Jul 27 19:26:16.908768 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.908635    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"
Jul 27 19:26:16.908768 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.908680    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" event={"ID":"9830f02e-e903-43dc-9b5c-ac8dadf18865","Type":"ContainerDied","Data":"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"}
Jul 27 19:26:16.908768 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.908744    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv" event={"ID":"9830f02e-e903-43dc-9b5c-ac8dadf18865","Type":"ContainerDied","Data":"fd6f95ca16587cba8df3c8b08a2da2c63e519909ba94fa10aed690c82f2b15bf"}
Jul 27 19:26:16.908949 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.908777    2567 scope.go:117] "RemoveContainer" containerID="9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"
Jul 27 19:26:16.910001 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.909982    2567 generic.go:356] "Generic (PLEG): container finished" podID="e632bf51-4c21-4146-a3e2-ad7b9075428c" containerID="4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d" exitCode=0
Jul 27 19:26:16.910080 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.910026    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"
Jul 27 19:26:16.910080 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.910034    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" event={"ID":"e632bf51-4c21-4146-a3e2-ad7b9075428c","Type":"ContainerDied","Data":"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"}
Jul 27 19:26:16.910171 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.910088    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr" event={"ID":"e632bf51-4c21-4146-a3e2-ad7b9075428c","Type":"ContainerDied","Data":"a3ba26ebb4213691b0b16de6dbe3560fa8e7a75c0906d1cb508b42cad4a01050"}
Jul 27 19:26:16.917187 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.917170    2567 scope.go:117] "RemoveContainer" containerID="9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"
Jul 27 19:26:16.917475 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:26:16.917457    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001\": container with ID starting with 9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001 not found: ID does not exist" containerID="9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"
Jul 27 19:26:16.917547 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.917484    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001"} err="failed to get container status \"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001\": rpc error: code = NotFound desc = could not find container \"9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001\": container with ID starting with 9e8e587975a6b70aee200ea02e6d8fcb4d263ef7f707949c3c716e3372bcf001 not found: ID does not exist"
Jul 27 19:26:16.917547 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.917501    2567 scope.go:117] "RemoveContainer" containerID="4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"
Jul 27 19:26:16.925016 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.925001    2567 scope.go:117] "RemoveContainer" containerID="4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"
Jul 27 19:26:16.925240 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:26:16.925223    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d\": container with ID starting with 4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d not found: ID does not exist" containerID="4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"
Jul 27 19:26:16.925303 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.925246    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d"} err="failed to get container status \"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d\": rpc error: code = NotFound desc = could not find container \"4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d\": container with ID starting with 4efb664916a3d5bf270b8e9600f5f0cb819eb45948aefe7bdb03f04a57d8779d not found: ID does not exist"
Jul 27 19:26:16.944344 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.944323    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:26:16.952276 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.952259    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-fa6952-5bf89cc5f8-jfdkr"]
Jul 27 19:26:16.981199 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.981179    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:26:16.994748 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:16.994727    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-fa6952-b4ff99668-t7mfv"]
Jul 27 19:26:18.383150 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:18.383117    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9830f02e-e903-43dc-9b5c-ac8dadf18865" path="/var/lib/kubelet/pods/9830f02e-e903-43dc-9b5c-ac8dadf18865/volumes"
Jul 27 19:26:18.383508 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:18.383487    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e632bf51-4c21-4146-a3e2-ad7b9075428c" path="/var/lib/kubelet/pods/e632bf51-4c21-4146-a3e2-ad7b9075428c/volumes"
Jul 27 19:26:21.135962 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:21.135927    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"]
Jul 27 19:26:21.147640 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:21.147615    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fa6952-mgt68"]
Jul 27 19:26:22.382066 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:22.382031    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fa7deb2-02de-4e39-8eee-b841e9006946" path="/var/lib/kubelet/pods/2fa7deb2-02de-4e39-8eee-b841e9006946/volumes"
Jul 27 19:26:25.203642 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:25.203610    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:26:32.540364 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540332    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"]
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540715    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e632bf51-4c21-4146-a3e2-ad7b9075428c" containerName="payload-processing"
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540727    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e632bf51-4c21-4146-a3e2-ad7b9075428c" containerName="payload-processing"
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540736    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9830f02e-e903-43dc-9b5c-ac8dadf18865" containerName="payload-pre-processing"
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540741    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9830f02e-e903-43dc-9b5c-ac8dadf18865" containerName="payload-pre-processing"
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540762    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fa7deb2-02de-4e39-8eee-b841e9006946" containerName="revoke-keys"
Jul 27 19:26:32.540772 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540769    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fa7deb2-02de-4e39-8eee-b841e9006946" containerName="revoke-keys"
Jul 27 19:26:32.540993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540815    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fa7deb2-02de-4e39-8eee-b841e9006946" containerName="revoke-keys"
Jul 27 19:26:32.540993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540822    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e632bf51-4c21-4146-a3e2-ad7b9075428c" containerName="payload-processing"
Jul 27 19:26:32.540993 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.540829    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9830f02e-e903-43dc-9b5c-ac8dadf18865" containerName="payload-pre-processing"
Jul 27 19:26:32.544925 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.544910    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:32.547764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.547744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:26:32.547864 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.547744    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:26:32.553518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.553495    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"]
Jul 27 19:26:32.666886 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.666861    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb\" (UID: \"7e30204f-4225-48fc-b723-33ace31023fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:32.767447 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.767424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb\" (UID: \"7e30204f-4225-48fc-b723-33ace31023fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:32.767974 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.767957    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb\" (UID: \"7e30204f-4225-48fc-b723-33ace31023fe\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:32.855135 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.855086    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:32.988200 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:32.988021    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"]
Jul 27 19:26:32.990752 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:26:32.990722    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e30204f_4225_48fc_b723_33ace31023fe.slice/crio-4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc WatchSource:0}: Error finding container 4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc: Status 404 returned error can't find the container with id 4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc
Jul 27 19:26:33.987026 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:33.987000    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e30204f-4225-48fc-b723-33ace31023fe" containerID="1bbabeb55bdaa4dd83aa5b9c6ae157563ed812cef65b171bc21697d817173ce9" exitCode=0
Jul 27 19:26:33.987371 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:33.987055    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb" event={"ID":"7e30204f-4225-48fc-b723-33ace31023fe","Type":"ContainerDied","Data":"1bbabeb55bdaa4dd83aa5b9c6ae157563ed812cef65b171bc21697d817173ce9"}
Jul 27 19:26:33.987371 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:33.987095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb" event={"ID":"7e30204f-4225-48fc-b723-33ace31023fe","Type":"ContainerStarted","Data":"4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc"}
Jul 27 19:26:35.128204 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.128180    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:35.285589 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.285526    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca\") pod \"7e30204f-4225-48fc-b723-33ace31023fe\" (UID: \"7e30204f-4225-48fc-b723-33ace31023fe\") "
Jul 27 19:26:35.285840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.285820    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7e30204f-4225-48fc-b723-33ace31023fe" (UID: "7e30204f-4225-48fc-b723-33ace31023fe"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:35.386208 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.386181    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e30204f-4225-48fc-b723-33ace31023fe-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:35.997757 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.997733    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"
Jul 27 19:26:35.998032 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.997770    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb" event={"ID":"7e30204f-4225-48fc-b723-33ace31023fe","Type":"ContainerDied","Data":"4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc"}
Jul 27 19:26:35.998032 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:35.997814    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4eb60f29a1059aa616d275abf24e5ad8b1ad877f7ff8e8ebf9cab72a63e1e4dc"
Jul 27 19:26:49.917436 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:49.917402    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:26:52.389138 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.389103    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:26:52.389585 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.389381    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" podUID="d380db62-1d44-4135-a3d6-1159464a426b" containerName="payload-processing" containerID="cri-o://5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79" gracePeriod=30
Jul 27 19:26:52.403886 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.403859    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:26:52.404087 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.404047    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" podUID="64109afc-fa76-43b5-9097-5821990e7a9e" containerName="payload-pre-processing" containerID="cri-o://99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee" gracePeriod=30
Jul 27 19:26:52.644662 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.644574    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"]
Jul 27 19:26:52.647182 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.647156    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-1d1107-ks5bb"]
Jul 27 19:26:52.679639 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.679607    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:26:52.682395 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.682379    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:26:52.813423 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813392    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n62k4\" (UniqueName: \"kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4\") pod \"64109afc-fa76-43b5-9097-5821990e7a9e\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") "
Jul 27 19:26:52.813423 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813426    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume\") pod \"d380db62-1d44-4135-a3d6-1159464a426b\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") "
Jul 27 19:26:52.813673 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813490    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume\") pod \"64109afc-fa76-43b5-9097-5821990e7a9e\" (UID: \"64109afc-fa76-43b5-9097-5821990e7a9e\") "
Jul 27 19:26:52.813673 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813532    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxfj2\" (UniqueName: \"kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2\") pod \"d380db62-1d44-4135-a3d6-1159464a426b\" (UID: \"d380db62-1d44-4135-a3d6-1159464a426b\") "
Jul 27 19:26:52.813869 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813845    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d380db62-1d44-4135-a3d6-1159464a426b" (UID: "d380db62-1d44-4135-a3d6-1159464a426b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:52.813937 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.813842    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "64109afc-fa76-43b5-9097-5821990e7a9e" (UID: "64109afc-fa76-43b5-9097-5821990e7a9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:26:52.815716 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.815690    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2" (OuterVolumeSpecName: "kube-api-access-gxfj2") pod "d380db62-1d44-4135-a3d6-1159464a426b" (UID: "d380db62-1d44-4135-a3d6-1159464a426b"). InnerVolumeSpecName "kube-api-access-gxfj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:26:52.815813 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.815711    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4" (OuterVolumeSpecName: "kube-api-access-n62k4") pod "64109afc-fa76-43b5-9097-5821990e7a9e" (UID: "64109afc-fa76-43b5-9097-5821990e7a9e"). InnerVolumeSpecName "kube-api-access-n62k4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:26:52.914970 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.914905    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n62k4\" (UniqueName: \"kubernetes.io/projected/64109afc-fa76-43b5-9097-5821990e7a9e-kube-api-access-n62k4\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:52.914970 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.914939    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d380db62-1d44-4135-a3d6-1159464a426b-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:52.914970 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.914949    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/64109afc-fa76-43b5-9097-5821990e7a9e-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:52.914970 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:52.914958    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxfj2\" (UniqueName: \"kubernetes.io/projected/d380db62-1d44-4135-a3d6-1159464a426b-kube-api-access-gxfj2\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:26:53.075303 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.075279    2567 generic.go:356] "Generic (PLEG): container finished" podID="d380db62-1d44-4135-a3d6-1159464a426b" containerID="5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79" exitCode=0
Jul 27 19:26:53.075397 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.075328    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"
Jul 27 19:26:53.075397 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.075329    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" event={"ID":"d380db62-1d44-4135-a3d6-1159464a426b","Type":"ContainerDied","Data":"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"}
Jul 27 19:26:53.075397 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.075382    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z" event={"ID":"d380db62-1d44-4135-a3d6-1159464a426b","Type":"ContainerDied","Data":"988b4ba89233c12156f79ac071dff31f5a83b407634b7aa634617992fff708bc"}
Jul 27 19:26:53.075568 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.075404    2567 scope.go:117] "RemoveContainer" containerID="5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"
Jul 27 19:26:53.076806 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.076784    2567 generic.go:356] "Generic (PLEG): container finished" podID="64109afc-fa76-43b5-9097-5821990e7a9e" containerID="99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee" exitCode=0
Jul 27 19:26:53.076897 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.076828    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"
Jul 27 19:26:53.076897 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.076835    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" event={"ID":"64109afc-fa76-43b5-9097-5821990e7a9e","Type":"ContainerDied","Data":"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"}
Jul 27 19:26:53.076897 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.076874    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg" event={"ID":"64109afc-fa76-43b5-9097-5821990e7a9e","Type":"ContainerDied","Data":"43ad0409d37da803efd8c04742435addd7487af0593f45db5ff7b9454f72af24"}
Jul 27 19:26:53.085545 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.085523    2567 scope.go:117] "RemoveContainer" containerID="5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"
Jul 27 19:26:53.085849 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:26:53.085829    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79\": container with ID starting with 5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79 not found: ID does not exist" containerID="5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"
Jul 27 19:26:53.085921 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.085859    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79"} err="failed to get container status \"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79\": rpc error: code = NotFound desc = could not find container \"5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79\": container with ID starting with 5c7cbb3157c25c7cfabdf6523452228d153aed3fc682a6865cfd0a875f835b79 not found: ID does not exist"
Jul 27 19:26:53.085921 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.085878    2567 scope.go:117] "RemoveContainer" containerID="99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"
Jul 27 19:26:53.093774 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.093757    2567 scope.go:117] "RemoveContainer" containerID="99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"
Jul 27 19:26:53.094018 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:26:53.093999    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee\": container with ID starting with 99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee not found: ID does not exist" containerID="99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"
Jul 27 19:26:53.094069 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.094025    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee"} err="failed to get container status \"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee\": rpc error: code = NotFound desc = could not find container \"99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee\": container with ID starting with 99881e4d6aa11dbe719f73525b0c4d6cb29f35568e0be354c899a2cd3138eeee not found: ID does not exist"
Jul 27 19:26:53.105751 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.105722    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:26:53.113120 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.113100    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-1d1107-db9fb4846-gds4z"]
Jul 27 19:26:53.151785 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.151765    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:26:53.162369 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:53.162349    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-1d1107-654b5596fb-f9qfg"]
Jul 27 19:26:54.382270 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:54.382243    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64109afc-fa76-43b5-9097-5821990e7a9e" path="/var/lib/kubelet/pods/64109afc-fa76-43b5-9097-5821990e7a9e/volumes"
Jul 27 19:26:54.382632 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:54.382551    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e30204f-4225-48fc-b723-33ace31023fe" path="/var/lib/kubelet/pods/7e30204f-4225-48fc-b723-33ace31023fe/volumes"
Jul 27 19:26:54.382856 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:26:54.382843    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d380db62-1d44-4135-a3d6-1159464a426b" path="/var/lib/kubelet/pods/d380db62-1d44-4135-a3d6-1159464a426b/volumes"
Jul 27 19:27:03.303131 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:03.303100    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:27:44.374877 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.374844    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"]
Jul 27 19:27:44.375400 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375331    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d380db62-1d44-4135-a3d6-1159464a426b" containerName="payload-processing"
Jul 27 19:27:44.375400 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375351    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d380db62-1d44-4135-a3d6-1159464a426b" containerName="payload-processing"
Jul 27 19:27:44.375400 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375384    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64109afc-fa76-43b5-9097-5821990e7a9e" containerName="payload-pre-processing"
Jul 27 19:27:44.375400 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375392    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="64109afc-fa76-43b5-9097-5821990e7a9e" containerName="payload-pre-processing"
Jul 27 19:27:44.375659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375403    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e30204f-4225-48fc-b723-33ace31023fe" containerName="revoke-keys"
Jul 27 19:27:44.375659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375412    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e30204f-4225-48fc-b723-33ace31023fe" containerName="revoke-keys"
Jul 27 19:27:44.375659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375524    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="64109afc-fa76-43b5-9097-5821990e7a9e" containerName="payload-pre-processing"
Jul 27 19:27:44.375659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375539    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e30204f-4225-48fc-b723-33ace31023fe" containerName="revoke-keys"
Jul 27 19:27:44.375659 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.375553    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d380db62-1d44-4135-a3d6-1159464a426b" containerName="payload-processing"
Jul 27 19:27:44.379166 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.379142    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:44.382372 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.382343    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:27:44.382504 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.382358    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:27:44.387782 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.387556    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"]
Jul 27 19:27:44.496972 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.496947    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8\" (UID: \"04e59456-3708-45f7-8b76-befc6332e135\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:44.597269 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.597234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8\" (UID: \"04e59456-3708-45f7-8b76-befc6332e135\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:44.597832 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.597810    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8\" (UID: \"04e59456-3708-45f7-8b76-befc6332e135\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:44.691005 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:44.690984    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:45.034171 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:45.034146    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"]
Jul 27 19:27:45.036708 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:27:45.036679    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04e59456_3708_45f7_8b76_befc6332e135.slice/crio-f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830 WatchSource:0}: Error finding container f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830: Status 404 returned error can't find the container with id f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830
Jul 27 19:27:45.309996 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:45.309957    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8" event={"ID":"04e59456-3708-45f7-8b76-befc6332e135","Type":"ContainerStarted","Data":"f1954c7374caf3eeccaea90db166b0b1f7f0b4544b9e3adc793a820a85c73d47"}
Jul 27 19:27:45.310103 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:45.310021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8" event={"ID":"04e59456-3708-45f7-8b76-befc6332e135","Type":"ContainerStarted","Data":"f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830"}
Jul 27 19:27:45.329864 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:45.329821    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8" podStartSLOduration=1.3298069479999999 podStartE2EDuration="1.329806948s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:27:45.32795883 +0000 UTC m=+3531.453813172" watchObservedRunningTime="2026-07-27 19:27:45.329806948 +0000 UTC m=+3531.455661322"
Jul 27 19:27:46.316657 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:46.316629    2567 generic.go:356] "Generic (PLEG): container finished" podID="04e59456-3708-45f7-8b76-befc6332e135" containerID="f1954c7374caf3eeccaea90db166b0b1f7f0b4544b9e3adc793a820a85c73d47" exitCode=0
Jul 27 19:27:46.317034 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:46.316694    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8" event={"ID":"04e59456-3708-45f7-8b76-befc6332e135","Type":"ContainerDied","Data":"f1954c7374caf3eeccaea90db166b0b1f7f0b4544b9e3adc793a820a85c73d47"}
Jul 27 19:27:47.451350 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:47.451323    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:47.518393 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:47.518368    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca\") pod \"04e59456-3708-45f7-8b76-befc6332e135\" (UID: \"04e59456-3708-45f7-8b76-befc6332e135\") "
Jul 27 19:27:47.518729 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:47.518704    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "04e59456-3708-45f7-8b76-befc6332e135" (UID: "04e59456-3708-45f7-8b76-befc6332e135"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:47.619398 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:47.619326    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04e59456-3708-45f7-8b76-befc6332e135-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:27:48.326173 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:48.326150    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"
Jul 27 19:27:48.326173 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:48.326161    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8" event={"ID":"04e59456-3708-45f7-8b76-befc6332e135","Type":"ContainerDied","Data":"f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830"}
Jul 27 19:27:48.326389 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:48.326207    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2f64f4ca97b6026b1f9e06a4a6096f0f603b9f7076fa64c7efe5079897da830"
Jul 27 19:27:56.038058 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.038023    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:27:56.038508 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.038275    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" podUID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" containerName="payload-processing" containerID="cri-o://da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c" gracePeriod=30
Jul 27 19:27:56.043887 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.043861    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:27:56.044112 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.044073    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" podUID="54d62d23-61d5-45bb-9510-596badcebe78" containerName="payload-pre-processing" containerID="cri-o://25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92" gracePeriod=30
Jul 27 19:27:56.318838 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.318811    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:27:56.322015 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.321994    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:27:56.364413 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.364389    2567 generic.go:356] "Generic (PLEG): container finished" podID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" containerID="da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c" exitCode=0
Jul 27 19:27:56.364577 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.364494    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"
Jul 27 19:27:56.364656 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.364491    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" event={"ID":"f15c14f3-d4a5-4174-911f-ca3a75f23be3","Type":"ContainerDied","Data":"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"}
Jul 27 19:27:56.364656 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.364623    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc" event={"ID":"f15c14f3-d4a5-4174-911f-ca3a75f23be3","Type":"ContainerDied","Data":"af90de60fdec9ac49fb952acff0ee672d433c9c1eba77be20cf358c023e9dcb9"}
Jul 27 19:27:56.364763 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.364658    2567 scope.go:117] "RemoveContainer" containerID="da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"
Jul 27 19:27:56.365904 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.365884    2567 generic.go:356] "Generic (PLEG): container finished" podID="54d62d23-61d5-45bb-9510-596badcebe78" containerID="25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92" exitCode=0
Jul 27 19:27:56.366003 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.365922    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" event={"ID":"54d62d23-61d5-45bb-9510-596badcebe78","Type":"ContainerDied","Data":"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"}
Jul 27 19:27:56.366003 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.365931    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"
Jul 27 19:27:56.366003 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.365953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd" event={"ID":"54d62d23-61d5-45bb-9510-596badcebe78","Type":"ContainerDied","Data":"7a3f42a57252d27be9b465d2a4960e2b402a5748c338321faaa0edc0c672f056"}
Jul 27 19:27:56.374580 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.374563    2567 scope.go:117] "RemoveContainer" containerID="da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"
Jul 27 19:27:56.374825 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:27:56.374807    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c\": container with ID starting with da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c not found: ID does not exist" containerID="da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"
Jul 27 19:27:56.374891 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.374832    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c"} err="failed to get container status \"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c\": rpc error: code = NotFound desc = could not find container \"da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c\": container with ID starting with da6e33b6cae5a165bc190c218bb2e374600b6d12963f92d184ffece9745b8a5c not found: ID does not exist"
Jul 27 19:27:56.374891 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.374846    2567 scope.go:117] "RemoveContainer" containerID="25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"
Jul 27 19:27:56.382907 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.382880    2567 scope.go:117] "RemoveContainer" containerID="25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"
Jul 27 19:27:56.383199 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:27:56.383178    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92\": container with ID starting with 25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92 not found: ID does not exist" containerID="25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"
Jul 27 19:27:56.383322 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.383203    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92"} err="failed to get container status \"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92\": rpc error: code = NotFound desc = could not find container \"25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92\": container with ID starting with 25438c74bc9a0fa9e5a8ad9719e9d93d6e46c967072cabca725b826d02782a92 not found: ID does not exist"
Jul 27 19:27:56.488911 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.488890    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume\") pod \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") "
Jul 27 19:27:56.489015 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.488930    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fmcl\" (UniqueName: \"kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl\") pod \"54d62d23-61d5-45bb-9510-596badcebe78\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") "
Jul 27 19:27:56.489015 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.488948    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dtc4d\" (UniqueName: \"kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d\") pod \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\" (UID: \"f15c14f3-d4a5-4174-911f-ca3a75f23be3\") "
Jul 27 19:27:56.489015 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.488968    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume\") pod \"54d62d23-61d5-45bb-9510-596badcebe78\" (UID: \"54d62d23-61d5-45bb-9510-596badcebe78\") "
Jul 27 19:27:56.489318 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.489294    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f15c14f3-d4a5-4174-911f-ca3a75f23be3" (UID: "f15c14f3-d4a5-4174-911f-ca3a75f23be3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:56.489474 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.489337    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "54d62d23-61d5-45bb-9510-596badcebe78" (UID: "54d62d23-61d5-45bb-9510-596badcebe78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:27:56.491003 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.490982    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl" (OuterVolumeSpecName: "kube-api-access-9fmcl") pod "54d62d23-61d5-45bb-9510-596badcebe78" (UID: "54d62d23-61d5-45bb-9510-596badcebe78"). InnerVolumeSpecName "kube-api-access-9fmcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:56.491081 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.491005    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d" (OuterVolumeSpecName: "kube-api-access-dtc4d") pod "f15c14f3-d4a5-4174-911f-ca3a75f23be3" (UID: "f15c14f3-d4a5-4174-911f-ca3a75f23be3"). InnerVolumeSpecName "kube-api-access-dtc4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:27:56.590180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.590123    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f15c14f3-d4a5-4174-911f-ca3a75f23be3-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:27:56.590180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.590147    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fmcl\" (UniqueName: \"kubernetes.io/projected/54d62d23-61d5-45bb-9510-596badcebe78-kube-api-access-9fmcl\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:27:56.590180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.590157    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dtc4d\" (UniqueName: \"kubernetes.io/projected/f15c14f3-d4a5-4174-911f-ca3a75f23be3-kube-api-access-dtc4d\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:27:56.590180 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.590166    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/54d62d23-61d5-45bb-9510-596badcebe78-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:27:56.688733 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.688708    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:27:56.694092 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.694068    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-0bd532-5f55b8bf48-z4xcd"]
Jul 27 19:27:56.704673 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.704648    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:27:56.707688 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:56.707670    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-0bd532-99dcbd956-t6qxc"]
Jul 27 19:27:58.381705 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:58.381677    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="54d62d23-61d5-45bb-9510-596badcebe78" path="/var/lib/kubelet/pods/54d62d23-61d5-45bb-9510-596badcebe78/volumes"
Jul 27 19:27:58.382074 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:58.381991    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" path="/var/lib/kubelet/pods/f15c14f3-d4a5-4174-911f-ca3a75f23be3/volumes"
Jul 27 19:27:59.382567 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:59.382529    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:27:59.460989 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:59.460961    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"]
Jul 27 19:27:59.467705 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:27:59.467667    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-0bd532-5rhw8"]
Jul 27 19:28:00.382088 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:00.382058    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04e59456-3708-45f7-8b76-befc6332e135" path="/var/lib/kubelet/pods/04e59456-3708-45f7-8b76-befc6332e135/volumes"
Jul 27 19:28:08.462607 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462572    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"]
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462876    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54d62d23-61d5-45bb-9510-596badcebe78" containerName="payload-pre-processing"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462886    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="54d62d23-61d5-45bb-9510-596badcebe78" containerName="payload-pre-processing"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462907    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04e59456-3708-45f7-8b76-befc6332e135" containerName="revoke-keys"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462913    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="04e59456-3708-45f7-8b76-befc6332e135" containerName="revoke-keys"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462921    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" containerName="payload-processing"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462927    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" containerName="payload-processing"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462974    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15c14f3-d4a5-4174-911f-ca3a75f23be3" containerName="payload-processing"
Jul 27 19:28:08.462981 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462984    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="04e59456-3708-45f7-8b76-befc6332e135" containerName="revoke-keys"
Jul 27 19:28:08.463242 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.462990    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="54d62d23-61d5-45bb-9510-596badcebe78" containerName="payload-pre-processing"
Jul 27 19:28:08.465797 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.465781    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:08.470945 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.470913    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:28:08.471171 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.471150    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:28:08.478652 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.478633    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"]
Jul 27 19:28:08.482257 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.482236    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z\" (UID: \"02e224b9-c1cd-4a2c-b52d-6ed741533894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:08.583031 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.583005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z\" (UID: \"02e224b9-c1cd-4a2c-b52d-6ed741533894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:08.583574 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.583558    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z\" (UID: \"02e224b9-c1cd-4a2c-b52d-6ed741533894\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:08.775956 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:08.775902    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:09.120159 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:09.120085    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"]
Jul 27 19:28:09.123290 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:28:09.123255    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e224b9_c1cd_4a2c_b52d_6ed741533894.slice/crio-5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7 WatchSource:0}: Error finding container 5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7: Status 404 returned error can't find the container with id 5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7
Jul 27 19:28:09.430050 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:09.429985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z" event={"ID":"02e224b9-c1cd-4a2c-b52d-6ed741533894","Type":"ContainerStarted","Data":"2abd5cc018bca55544d6b4f4fbc0e0afda1cf149556f93435713c1d574a10f18"}
Jul 27 19:28:09.430152 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:09.430050    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z" event={"ID":"02e224b9-c1cd-4a2c-b52d-6ed741533894","Type":"ContainerStarted","Data":"5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7"}
Jul 27 19:28:09.452076 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:09.452035    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z" podStartSLOduration=1.452021086 podStartE2EDuration="1.452021086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-27 19:28:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:28:09.45051216 +0000 UTC m=+3555.576366501" watchObservedRunningTime="2026-07-27 19:28:09.452021086 +0000 UTC m=+3555.577875429"
Jul 27 19:28:10.435846 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:10.435815    2567 generic.go:356] "Generic (PLEG): container finished" podID="02e224b9-c1cd-4a2c-b52d-6ed741533894" containerID="2abd5cc018bca55544d6b4f4fbc0e0afda1cf149556f93435713c1d574a10f18" exitCode=0
Jul 27 19:28:10.436201 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:10.435885    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z" event={"ID":"02e224b9-c1cd-4a2c-b52d-6ed741533894","Type":"ContainerDied","Data":"2abd5cc018bca55544d6b4f4fbc0e0afda1cf149556f93435713c1d574a10f18"}
Jul 27 19:28:11.562408 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:11.562387    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:11.602877 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:11.602852    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca\") pod \"02e224b9-c1cd-4a2c-b52d-6ed741533894\" (UID: \"02e224b9-c1cd-4a2c-b52d-6ed741533894\") "
Jul 27 19:28:11.603131 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:11.603107    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02e224b9-c1cd-4a2c-b52d-6ed741533894" (UID: "02e224b9-c1cd-4a2c-b52d-6ed741533894"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:11.703484 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:11.703407    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02e224b9-c1cd-4a2c-b52d-6ed741533894-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:12.444892 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:12.444851    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z" event={"ID":"02e224b9-c1cd-4a2c-b52d-6ed741533894","Type":"ContainerDied","Data":"5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7"}
Jul 27 19:28:12.445019 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:12.444906    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cd4b7af36db9d5a23946db98b776dc0a3094e0be11fb0b580fb088ba21470c7"
Jul 27 19:28:12.445019 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:12.444866    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"
Jul 27 19:28:19.826674 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:19.826639    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:28:19.827133 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:19.826897    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" podUID="452adebd-e0ad-4c23-92e5-0d1c232e1902" containerName="payload-processing" containerID="cri-o://5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff" gracePeriod=30
Jul 27 19:28:19.854064 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:19.854037    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:28:19.854302 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:19.854279    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" podUID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" containerName="payload-pre-processing" containerID="cri-o://89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294" gracePeriod=30
Jul 27 19:28:20.126206 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.126183    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:28:20.128741 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.128720    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:28:20.161215 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.161189    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjm9d\" (UniqueName: \"kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d\") pod \"452adebd-e0ad-4c23-92e5-0d1c232e1902\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") "
Jul 27 19:28:20.161345 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.161241    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r8b7d\" (UniqueName: \"kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d\") pod \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") "
Jul 27 19:28:20.161345 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.161332    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume\") pod \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\" (UID: \"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf\") "
Jul 27 19:28:20.161495 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.161372    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume\") pod \"452adebd-e0ad-4c23-92e5-0d1c232e1902\" (UID: \"452adebd-e0ad-4c23-92e5-0d1c232e1902\") "
Jul 27 19:28:20.162042 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.161999    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "452adebd-e0ad-4c23-92e5-0d1c232e1902" (UID: "452adebd-e0ad-4c23-92e5-0d1c232e1902"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:20.162685 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.162489    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" (UID: "d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:20.163912 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.163872    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d" (OuterVolumeSpecName: "kube-api-access-r8b7d") pod "d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" (UID: "d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf"). InnerVolumeSpecName "kube-api-access-r8b7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:20.164106 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.164082    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d" (OuterVolumeSpecName: "kube-api-access-kjm9d") pod "452adebd-e0ad-4c23-92e5-0d1c232e1902" (UID: "452adebd-e0ad-4c23-92e5-0d1c232e1902"). InnerVolumeSpecName "kube-api-access-kjm9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:20.263083 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.263056    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/452adebd-e0ad-4c23-92e5-0d1c232e1902-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:20.263202 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.263088    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjm9d\" (UniqueName: \"kubernetes.io/projected/452adebd-e0ad-4c23-92e5-0d1c232e1902-kube-api-access-kjm9d\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:20.263202 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.263105    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8b7d\" (UniqueName: \"kubernetes.io/projected/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-kube-api-access-r8b7d\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:20.263202 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.263131    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:20.481163 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.481130    2567 generic.go:356] "Generic (PLEG): container finished" podID="452adebd-e0ad-4c23-92e5-0d1c232e1902" containerID="5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff" exitCode=0
Jul 27 19:28:20.481266 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.481191    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"
Jul 27 19:28:20.481266 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.481217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" event={"ID":"452adebd-e0ad-4c23-92e5-0d1c232e1902","Type":"ContainerDied","Data":"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"}
Jul 27 19:28:20.481377 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.481269    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m" event={"ID":"452adebd-e0ad-4c23-92e5-0d1c232e1902","Type":"ContainerDied","Data":"4919f7358e75b40e83b38db21169f178de89e6c3b91ec2def1e1a9f811f2ba10"}
Jul 27 19:28:20.481377 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.481306    2567 scope.go:117] "RemoveContainer" containerID="5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"
Jul 27 19:28:20.482563 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.482544    2567 generic.go:356] "Generic (PLEG): container finished" podID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" containerID="89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294" exitCode=0
Jul 27 19:28:20.482840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.482596    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"
Jul 27 19:28:20.482840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.482602    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" event={"ID":"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf","Type":"ContainerDied","Data":"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"}
Jul 27 19:28:20.482840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.482637    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl" event={"ID":"d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf","Type":"ContainerDied","Data":"fe3a810d6687d6d8bac1b6ece4cd76cc333b29c0b77f6eb297c26ae6c7615611"}
Jul 27 19:28:20.489642 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.489626    2567 scope.go:117] "RemoveContainer" containerID="5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"
Jul 27 19:28:20.489868 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:28:20.489852    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff\": container with ID starting with 5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff not found: ID does not exist" containerID="5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"
Jul 27 19:28:20.489920 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.489874    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff"} err="failed to get container status \"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff\": rpc error: code = NotFound desc = could not find container \"5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff\": container with ID starting with 5f8d9748cdbd7029ac835cc01368a96dd940d1ccbcc36ef2b3286804dfb634ff not found: ID does not exist"
Jul 27 19:28:20.489920 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.489888    2567 scope.go:117] "RemoveContainer" containerID="89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"
Jul 27 19:28:20.497250 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.497239    2567 scope.go:117] "RemoveContainer" containerID="89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"
Jul 27 19:28:20.497517 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:28:20.497488    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294\": container with ID starting with 89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294 not found: ID does not exist" containerID="89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"
Jul 27 19:28:20.497615 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.497525    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294"} err="failed to get container status \"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294\": rpc error: code = NotFound desc = could not find container \"89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294\": container with ID starting with 89825113157e65c22e0875745d4b56029b4c554275107b35a6555455f3862294 not found: ID does not exist"
Jul 27 19:28:20.510927 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.510898    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:28:20.518490 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.518470    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-7f7473-b8f4d7ff6-2bffl"]
Jul 27 19:28:20.546751 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.546732    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:28:20.553807 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:20.553787    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-7f7473-79d65b9f58-dxh9m"]
Jul 27 19:28:22.381986 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:22.381958    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="452adebd-e0ad-4c23-92e5-0d1c232e1902" path="/var/lib/kubelet/pods/452adebd-e0ad-4c23-92e5-0d1c232e1902/volumes"
Jul 27 19:28:22.382333 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:22.382274    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" path="/var/lib/kubelet/pods/d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf/volumes"
Jul 27 19:28:23.674704 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:23.674669    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"]
Jul 27 19:28:23.676999 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:23.676980    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-7f7473-g8k7z"]
Jul 27 19:28:24.381814 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:24.381782    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02e224b9-c1cd-4a2c-b52d-6ed741533894" path="/var/lib/kubelet/pods/02e224b9-c1cd-4a2c-b52d-6ed741533894/volumes"
Jul 27 19:28:25.751496 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:25.751459    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:28:35.014655 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014621    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"]
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014925    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e224b9-c1cd-4a2c-b52d-6ed741533894" containerName="revoke-keys"
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014935    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e224b9-c1cd-4a2c-b52d-6ed741533894" containerName="revoke-keys"
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014950    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" containerName="payload-pre-processing"
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014956    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" containerName="payload-pre-processing"
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014965    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="452adebd-e0ad-4c23-92e5-0d1c232e1902" containerName="payload-processing"
Jul 27 19:28:35.015008 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.014971    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="452adebd-e0ad-4c23-92e5-0d1c232e1902" containerName="payload-processing"
Jul 27 19:28:35.015210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.015019    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3428061-8f54-4fa2-bb4b-ef3ad91ec3cf" containerName="payload-pre-processing"
Jul 27 19:28:35.015210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.015027    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e224b9-c1cd-4a2c-b52d-6ed741533894" containerName="revoke-keys"
Jul 27 19:28:35.015210 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.015034    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="452adebd-e0ad-4c23-92e5-0d1c232e1902" containerName="payload-processing"
Jul 27 19:28:35.019264 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.019246    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:35.023522 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.023461    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-466q9\""
Jul 27 19:28:35.023645 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.023628    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 27 19:28:35.043909 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.043888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"]
Jul 27 19:28:35.078100 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.078070    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst\" (UID: \"b2c8119f-ca89-4f94-be3b-2ece6478bad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:35.178899 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.178872    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst\" (UID: \"b2c8119f-ca89-4f94-be3b-2ece6478bad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:35.179400 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.179382    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst\" (UID: \"b2c8119f-ca89-4f94-be3b-2ece6478bad7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:35.329551 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.329497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:35.460353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.460325    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"]
Jul 27 19:28:35.462799 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:28:35.462774    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2c8119f_ca89_4f94_be3b_2ece6478bad7.slice/crio-52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9 WatchSource:0}: Error finding container 52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9: Status 404 returned error can't find the container with id 52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9
Jul 27 19:28:35.551726 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:35.551695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst" event={"ID":"b2c8119f-ca89-4f94-be3b-2ece6478bad7","Type":"ContainerStarted","Data":"52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9"}
Jul 27 19:28:36.557043 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:36.557009    2567 generic.go:356] "Generic (PLEG): container finished" podID="b2c8119f-ca89-4f94-be3b-2ece6478bad7" containerID="55e004acfe96cd5f483884e52ed3feccda9e47a6af61647551af9c93be5420f7" exitCode=0
Jul 27 19:28:36.557391 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:36.557084    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst" event={"ID":"b2c8119f-ca89-4f94-be3b-2ece6478bad7","Type":"ContainerDied","Data":"55e004acfe96cd5f483884e52ed3feccda9e47a6af61647551af9c93be5420f7"}
Jul 27 19:28:37.690591 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:37.690569    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:37.802628 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:37.802600    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca\") pod \"b2c8119f-ca89-4f94-be3b-2ece6478bad7\" (UID: \"b2c8119f-ca89-4f94-be3b-2ece6478bad7\") "
Jul 27 19:28:37.802913 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:37.802894    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b2c8119f-ca89-4f94-be3b-2ece6478bad7" (UID: "b2c8119f-ca89-4f94-be3b-2ece6478bad7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:37.904077 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:37.904019    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2c8119f-ca89-4f94-be3b-2ece6478bad7-maas-api-service-ca\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:38.566812 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:38.566781    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"
Jul 27 19:28:38.566968 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:38.566821    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst" event={"ID":"b2c8119f-ca89-4f94-be3b-2ece6478bad7","Type":"ContainerDied","Data":"52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9"}
Jul 27 19:28:38.566968 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:38.566880    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52ec6d19702dbc743b4de164b24fdc6cb2ea8012c1bbc81c0ba3e4e49a3e45d9"
Jul 27 19:28:47.961482 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:47.961387    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:28:47.962023 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:47.961627    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" podUID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" containerName="payload-processing" containerID="cri-o://442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619" gracePeriod=30
Jul 27 19:28:47.962990 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:47.962968    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:28:47.963146 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:47.963127    2567 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" podUID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" containerName="payload-pre-processing" containerID="cri-o://c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2" gracePeriod=30
Jul 27 19:28:48.232956 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.232935    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:28:48.235707 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.235690    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:28:48.384522 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384500    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jlz7f\" (UniqueName: \"kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f\") pod \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") "
Jul 27 19:28:48.384681 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rswfj\" (UniqueName: \"kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj\") pod \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") "
Jul 27 19:28:48.384681 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384577    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume\") pod \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\" (UID: \"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2\") "
Jul 27 19:28:48.384681 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384645    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume\") pod \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\" (UID: \"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9\") "
Jul 27 19:28:48.384972 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384947    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" (UID: "88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:48.384972 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.384944    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" (UID: "ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 27 19:28:48.386769 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.386748    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f" (OuterVolumeSpecName: "kube-api-access-jlz7f") pod "88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" (UID: "88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9"). InnerVolumeSpecName "kube-api-access-jlz7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:48.386867 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.386852    2567 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj" (OuterVolumeSpecName: "kube-api-access-rswfj") pod "ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" (UID: "ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2"). InnerVolumeSpecName "kube-api-access-rswfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 27 19:28:48.486104 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.486051    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rswfj\" (UniqueName: \"kubernetes.io/projected/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-kube-api-access-rswfj\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:48.486104 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.486070    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:48.486104 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.486079    2567 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-plugins-config-volume\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:48.486104 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.486087    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlz7f\" (UniqueName: \"kubernetes.io/projected/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9-kube-api-access-jlz7f\") on node \"ip-10-0-134-47.ec2.internal\" DevicePath \"\""
Jul 27 19:28:48.609817 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.609792    2567 generic.go:356] "Generic (PLEG): container finished" podID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" containerID="442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619" exitCode=0
Jul 27 19:28:48.609924 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.609834    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"
Jul 27 19:28:48.609924 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.609884    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" event={"ID":"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2","Type":"ContainerDied","Data":"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"}
Jul 27 19:28:48.610099 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.609938    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5" event={"ID":"ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2","Type":"ContainerDied","Data":"8f54ed9317c34c4eb24537abce67f1e0950769244b9e4e902d71f98e28329c35"}
Jul 27 19:28:48.610099 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.609973    2567 scope.go:117] "RemoveContainer" containerID="442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"
Jul 27 19:28:48.611134 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.611117    2567 generic.go:356] "Generic (PLEG): container finished" podID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" containerID="c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2" exitCode=0
Jul 27 19:28:48.611219 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.611140    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" event={"ID":"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9","Type":"ContainerDied","Data":"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"}
Jul 27 19:28:48.611219 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.611174    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"
Jul 27 19:28:48.611219 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.611185    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs" event={"ID":"88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9","Type":"ContainerDied","Data":"6ed4261b95c73e078a8f0f40b85f5c223cc411da93f9d7d546dea6c38b5f652c"}
Jul 27 19:28:48.619541 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.619523    2567 scope.go:117] "RemoveContainer" containerID="442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"
Jul 27 19:28:48.619800 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:28:48.619778    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619\": container with ID starting with 442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619 not found: ID does not exist" containerID="442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"
Jul 27 19:28:48.619860 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.619815    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619"} err="failed to get container status \"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619\": rpc error: code = NotFound desc = could not find container \"442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619\": container with ID starting with 442552bcc4dd15303aef83f122ce16ec105f2b54a71c293d47d3825e4a750619 not found: ID does not exist"
Jul 27 19:28:48.619860 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.619833    2567 scope.go:117] "RemoveContainer" containerID="c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"
Jul 27 19:28:48.627266 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.627249    2567 scope.go:117] "RemoveContainer" containerID="c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"
Jul 27 19:28:48.627534 ip-10-0-134-47 kubenswrapper[2567]: E0727 19:28:48.627516    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2\": container with ID starting with c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2 not found: ID does not exist" containerID="c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"
Jul 27 19:28:48.627592 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.627542    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2"} err="failed to get container status \"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2\": rpc error: code = NotFound desc = could not find container \"c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2\": container with ID starting with c914ee4a1cbac60933a0503ba6be17cf595be42b97bbc557b1a910eb714006f2 not found: ID does not exist"
Jul 27 19:28:48.639509 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.639488    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:28:48.642718 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.642701    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-6710a9-dbb95b9d6-svdt5"]
Jul 27 19:28:48.666494 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.666467    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:28:48.669731 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:48.669711    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-6710a9-6457ffbfcb-v5pcs"]
Jul 27 19:28:50.200380 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:50.200340    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"]
Jul 27 19:28:50.232452 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:50.232409    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-6710a9-4ctst"]
Jul 27 19:28:50.382187 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:50.382157    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" path="/var/lib/kubelet/pods/88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9/volumes"
Jul 27 19:28:50.382485 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:50.382472    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2c8119f-ca89-4f94-be3b-2ece6478bad7" path="/var/lib/kubelet/pods/b2c8119f-ca89-4f94-be3b-2ece6478bad7/volumes"
Jul 27 19:28:50.382774 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:50.382762    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" path="/var/lib/kubelet/pods/ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2/volumes"
Jul 27 19:28:51.001024 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:28:51.000998    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-5jdv5"]
Jul 27 19:29:06.070461 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:06.070412    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vc8p9_8b90f79d-8e9d-4a32-8f23-1a85e475459a/server/0.log"
Jul 27 19:29:06.628855 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:06.628830    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d99c84d4-xgnmr_30bd9678-8e3e-40e9-9081-1e0aaa795d8a/copy-manifests/0.log"
Jul 27 19:29:06.642056 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:06.642036    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d99c84d4-xgnmr_30bd9678-8e3e-40e9-9081-1e0aaa795d8a/manager/0.log"
Jul 27 19:29:09.388941 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:09.388912    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5jdv5_31bb8858-538d-44fb-a592-a0447aa4f3cd/limitador/0.log"
Jul 27 19:29:10.007214 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:10.007188    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vdp9t_b5a7007c-6cda-42af-9120-cc9a07a0d3e0/discovery/0.log"
Jul 27 19:29:11.549143 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:11.549117    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fmrgdk_5bb96ade-d3c4-44bf-87a0-bbdd65398d88/main/0.log"
Jul 27 19:29:21.376886 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:21.376851    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xfzx4_40a32a8f-1059-44c0-acaa-b8209ca2401a/global-pull-secret-syncer/0.log"
Jul 27 19:29:21.536514 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:21.536490    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-vz7tn_bc0e49eb-80a1-4841-9918-28b397567670/konnectivity-agent/0.log"
Jul 27 19:29:21.618329 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:21.618303    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-47.ec2.internal_4a73749570711c6068d304e4f5dc5093/haproxy/0.log"
Jul 27 19:29:27.168961 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:27.168892    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-5jdv5_31bb8858-538d-44fb-a592-a0447aa4f3cd/limitador/0.log"
Jul 27 19:29:29.718167 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:29.718144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-85ddc647bf-v5gbr_fefa6f45-636f-44d9-a451-ba514dd6c3bc/metrics-server/0.log"
Jul 27 19:29:29.766279 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:29.766250    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-stjbj_6811a1e7-5ad8-4bb7-a926-b08bb3bd4cdd/monitoring-plugin/0.log"
Jul 27 19:29:30.073165 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.073144    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9rkt_410ea204-9785-4eb4-9498-e83f900f8169/node-exporter/0.log"
Jul 27 19:29:30.102148 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.102123    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9rkt_410ea204-9785-4eb4-9498-e83f900f8169/kube-rbac-proxy/0.log"
Jul 27 19:29:30.128566 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.128546    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-v9rkt_410ea204-9785-4eb4-9498-e83f900f8169/init-textfile/0.log"
Jul 27 19:29:30.269711 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.269687    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/prometheus/0.log"
Jul 27 19:29:30.330818 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.330770    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/config-reloader/0.log"
Jul 27 19:29:30.387192 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.387172    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/thanos-sidecar/0.log"
Jul 27 19:29:30.424249 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.424231    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/kube-rbac-proxy-web/0.log"
Jul 27 19:29:30.464084 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.464068    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/kube-rbac-proxy/0.log"
Jul 27 19:29:30.501347 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.501332    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/kube-rbac-proxy-thanos/0.log"
Jul 27 19:29:30.551903 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:30.551868    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e7a07edf-1fcf-4182-a7ae-a78c8853588e/init-config-reloader/0.log"
Jul 27 19:29:31.145115 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145085    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"]
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145383    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" containerName="payload-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145395    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" containerName="payload-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145404    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2c8119f-ca89-4f94-be3b-2ece6478bad7" containerName="revoke-keys"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145410    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2c8119f-ca89-4f94-be3b-2ece6478bad7" containerName="revoke-keys"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145424    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" containerName="payload-pre-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145429    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" containerName="payload-pre-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145504    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="88b3b24f-6bd1-4a40-b2bc-fdd9c9dc10e9" containerName="payload-pre-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145514    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccc69f3d-7fd2-4aea-8976-8c3076d1f1e2" containerName="payload-processing"
Jul 27 19:29:31.145518 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.145520    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2c8119f-ca89-4f94-be3b-2ece6478bad7" containerName="revoke-keys"
Jul 27 19:29:31.148642 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.148624    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.152265 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.152248    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pshc7\"/\"default-dockercfg-55v4q\""
Jul 27 19:29:31.152369 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.152351    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pshc7\"/\"kube-root-ca.crt\""
Jul 27 19:29:31.153208 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.153189    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pshc7\"/\"openshift-service-ca.crt\""
Jul 27 19:29:31.167844 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.167824    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"]
Jul 27 19:29:31.186694 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.186675    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-lib-modules\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.186789 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.186705    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-sys\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.186836 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.186792    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-podres\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.186836 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.186825    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjhkk\" (UniqueName: \"kubernetes.io/projected/912443db-9678-4cbd-8866-e337c90a17b6-kube-api-access-tjhkk\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.186900 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.186843    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-proc\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287568 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287548    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-podres\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjhkk\" (UniqueName: \"kubernetes.io/projected/912443db-9678-4cbd-8866-e337c90a17b6-kube-api-access-tjhkk\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287601    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-proc\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287619    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-lib-modules\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287671 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287639    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-sys\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287688    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-proc\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287730    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-podres\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287736    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-sys\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.287863 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.287762    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/912443db-9678-4cbd-8866-e337c90a17b6-lib-modules\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.297309 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.297278    2567 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjhkk\" (UniqueName: \"kubernetes.io/projected/912443db-9678-4cbd-8866-e337c90a17b6-kube-api-access-tjhkk\") pod \"perf-node-gather-daemonset-t7d7v\" (UID: \"912443db-9678-4cbd-8866-e337c90a17b6\") " pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.458764 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.458744    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.592840 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.592816    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"]
Jul 27 19:29:31.595214 ip-10-0-134-47 kubenswrapper[2567]: W0727 19:29:31.595189    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod912443db_9678_4cbd_8866_e337c90a17b6.slice/crio-a648e848c422834864bb034a63fdce019233eaa562aa71124cd3d449133bd670 WatchSource:0}: Error finding container a648e848c422834864bb034a63fdce019233eaa562aa71124cd3d449133bd670: Status 404 returned error can't find the container with id a648e848c422834864bb034a63fdce019233eaa562aa71124cd3d449133bd670
Jul 27 19:29:31.799128 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.799071    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v" event={"ID":"912443db-9678-4cbd-8866-e337c90a17b6","Type":"ContainerStarted","Data":"a6df95b7926d20d37053f50219117399e79748204828eb22c554aebe1f2c54d4"}
Jul 27 19:29:31.799128 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.799120    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v" event={"ID":"912443db-9678-4cbd-8866-e337c90a17b6","Type":"ContainerStarted","Data":"a648e848c422834864bb034a63fdce019233eaa562aa71124cd3d449133bd670"}
Jul 27 19:29:31.799285 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.799178    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:31.819997 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:31.819957    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v" podStartSLOduration=0.819942967 podStartE2EDuration="819.942967ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-27 19:29:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-27 19:29:31.818784237 +0000 UTC m=+3637.944638594" watchObservedRunningTime="2026-07-27 19:29:31.819942967 +0000 UTC m=+3637.945797312"
Jul 27 19:29:35.334711 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:35.334683    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frdg6_1bef2d2a-5272-47a3-9d57-c245174f4cb7/dns/0.log"
Jul 27 19:29:35.362485 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:35.362460    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-frdg6_1bef2d2a-5272-47a3-9d57-c245174f4cb7/kube-rbac-proxy/0.log"
Jul 27 19:29:35.536540 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:35.536519    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-phbsr_7140841e-dc03-4418-b626-52810a3d3573/dns-node-resolver/0.log"
Jul 27 19:29:36.234759 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:36.234733    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5ddf9d4b7b-m79xl_fc8fa7cc-98c1-429a-ac17-fe7d1e9c489f/registry/0.log"
Jul 27 19:29:36.324791 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:36.324767    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-grbv2_e0ebc520-7f9a-43d7-879f-7788ae8c71e1/node-ca/0.log"
Jul 27 19:29:37.600890 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:37.600862    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vdp9t_b5a7007c-6cda-42af-9120-cc9a07a0d3e0/discovery/0.log"
Jul 27 19:29:37.813611 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:37.813587    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pshc7/perf-node-gather-daemonset-t7d7v"
Jul 27 19:29:38.987321 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:38.987289    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bg92n_280b7998-ab95-44ab-87c6-fb4c6e0d4bd7/serve-healthcheck-canary/0.log"
Jul 27 19:29:39.989065 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:39.989036    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8j_9a5210ea-1cf6-4807-b9df-bc386b4c2960/kube-rbac-proxy/0.log"
Jul 27 19:29:40.066353 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:40.066326    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8j_9a5210ea-1cf6-4807-b9df-bc386b4c2960/exporter/0.log"
Jul 27 19:29:40.133360 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:40.133334    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zwb8j_9a5210ea-1cf6-4807-b9df-bc386b4c2960/extractor/0.log"
Jul 27 19:29:42.099181 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:42.099156    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vdp9t_b5a7007c-6cda-42af-9120-cc9a07a0d3e0/discovery/0.log"
Jul 27 19:29:43.814605 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:43.814574    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vc8p9_8b90f79d-8e9d-4a32-8f23-1a85e475459a/server/0.log"
Jul 27 19:29:43.928816 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:43.928790    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vdp9t_b5a7007c-6cda-42af-9120-cc9a07a0d3e0/discovery/0.log"
Jul 27 19:29:44.197376 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:44.197351    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d99c84d4-xgnmr_30bd9678-8e3e-40e9-9081-1e0aaa795d8a/manager/0.log"
Jul 27 19:29:44.216779 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:44.216756    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57d99c84d4-xgnmr_30bd9678-8e3e-40e9-9081-1e0aaa795d8a/copy-manifests/0.log"
Jul 27 19:29:45.510220 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:45.510194    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7cc45b746b-jzcn6_27fb38c0-fb57-4c7f-9bde-8b261578a403/manager/0.log"
Jul 27 19:29:45.573541 ip-10-0-134-47 kubenswrapper[2567]: I0727 19:29:45.573500    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-lwhw2_71f0c127-baab-4f50-90a7-5e37ae771d50/openshift-lws-operator/0.log"