Aug 05 16:19:37.099067 ip-10-0-134-153 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Aug 05 16:19:37.099077 ip-10-0-134-153 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Aug 05 16:19:37.099086 ip-10-0-134-153 systemd[1]: kubelet.service: Failed with result 'resources'.
Aug 05 16:19:37.099306 ip-10-0-134-153 systemd[1]: Failed to start Kubernetes Kubelet.
Aug 05 16:19:47.332051 ip-10-0-134-153 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Aug 05 16:19:47.332065 ip-10-0-134-153 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot a76494ee22ff440883221ef0dca746ee --
Aug 05 16:21:25.610613 ip-10-0-134-153 systemd[1]: Starting Kubernetes Kubelet...
Aug 05 16:21:26.057671 ip-10-0-134-153 kubenswrapper[2546]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:26.057671 ip-10-0-134-153 kubenswrapper[2546]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Aug 05 16:21:26.057671 ip-10-0-134-153 kubenswrapper[2546]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:26.057671 ip-10-0-134-153 kubenswrapper[2546]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Aug 05 16:21:26.057671 ip-10-0-134-153 kubenswrapper[2546]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Aug 05 16:21:26.059832 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.059713    2546 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Aug 05 16:21:26.064399 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064384    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.064399 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064399    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064402    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064406    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064409    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064412    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064416    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064418    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064422    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064426    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064431    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064434    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064437    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064440    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064443    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064445    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064449    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064451    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064454    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064456    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.064464 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064459    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064462    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064465    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064468    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064472    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064478    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064481    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064484    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064487    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064490    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064493    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064497    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064499    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064502    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064505    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064508    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064510    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064512    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064515    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.064912 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064517    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064520    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064522    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064525    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064528    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064530    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064533    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064535    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064538    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064540    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064544    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064548    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064550    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064553    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064556    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064559    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064561    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064564    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064567    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064570    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.065382 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064573    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064576    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064579    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064581    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064584    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064587    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064589    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064592    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064594    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064597    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064599    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064602    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064604    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064607    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064609    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064612    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064614    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064617    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064619    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064622    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.065864 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064624    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064627    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064629    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064633    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064636    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064638    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064642    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064645    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064647    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064650    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064652    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064655    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064657    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064660    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064663    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064666    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064668    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064670    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064673    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.066401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.064675    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065415    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065422    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065425    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065428    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065431    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065435    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065438    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065441    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065444    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065447    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065449    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065452    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065455    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065457    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065460    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065463    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065466    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065469    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065471    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.066868 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065474    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065477    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065479    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065482    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065485    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065488    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065492    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065495    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065498    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065501    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065504    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065506    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065510    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065512    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065515    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065517    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065519    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065522    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065536    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065540    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.067372 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065543    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065546    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065548    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065551    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065554    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065557    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065560    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065563    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065566    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065570    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065572    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065576    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065579    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065581    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065585    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065587    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065590    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065594    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065597    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065600    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.067860 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065603    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065607    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065609    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065612    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065615    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065618    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065621    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065623    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065626    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065629    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065631    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065633    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065636    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065638    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065641    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065643    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065645    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065648    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065651    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065654    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.068361 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065657    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065659    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065662    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065665    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065668    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065670    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065673    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065675    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065678    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065680    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065683    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065685    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065688    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065692    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065696    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065699    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065701    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065704    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065707    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.068849 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.065709    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066073    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066078    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066081    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066086    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066089    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066092    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066094    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066097    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066100    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066102    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066105    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066108    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066110    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066113    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066116    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066119    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066122    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066124    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066127    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.069341 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066129    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066132    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066135    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066137    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066140    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066142    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066145    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066148    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066151    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066154    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066156    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066159    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066161    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066164    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066166    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066170    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066176    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066179    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066182    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.069829 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066185    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066188    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066191    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066194    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066196    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066200    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066204    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066207    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066210    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066213    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066216    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066218    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066221    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066223    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066226    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066228    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066231    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066233    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066236    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.070307 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066238    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066241    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066244    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066246    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066249    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066251    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066254    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066256    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066259    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066261    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066265    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066268    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066270    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066273    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066276    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066280    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066283    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066286    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066289    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066292    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.070781 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066295    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066298    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066301    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066303    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066306    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066308    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066311    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066314    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066316    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066319    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066334    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066337    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066340    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066342    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066345    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066348    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066351    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066354    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066356    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.071265 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066359    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066361    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.066364    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066430    2546 flags.go:64] FLAG: --address="0.0.0.0"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066436    2546 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066442    2546 flags.go:64] FLAG: --anonymous-auth="true"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066446    2546 flags.go:64] FLAG: --application-metrics-count-limit="100"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066450    2546 flags.go:64] FLAG: --authentication-token-webhook="false"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066453    2546 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066458    2546 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066462    2546 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066465    2546 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066468    2546 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066471    2546 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066475    2546 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066478    2546 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066481    2546 flags.go:64] FLAG: --cgroup-root=""
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066484    2546 flags.go:64] FLAG: --cgroups-per-qos="true"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066487    2546 flags.go:64] FLAG: --client-ca-file=""
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066490    2546 flags.go:64] FLAG: --cloud-provider="external"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066493    2546 flags.go:64] FLAG: --cluster-dns="[]"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066498    2546 flags.go:64] FLAG: --cluster-domain=""
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066500    2546 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066504    2546 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Aug 05 16:21:26.071734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066507    2546 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066510    2546 flags.go:64] FLAG: --container-log-max-files="5"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066514    2546 flags.go:64] FLAG: --container-log-max-size="10Mi"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066517    2546 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066520    2546 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066524    2546 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066528    2546 flags.go:64] FLAG: --contention-profiling="false"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066530    2546 flags.go:64] FLAG: --cpu-cfs-quota="true"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066533    2546 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066537    2546 flags.go:64] FLAG: --cpu-manager-policy="none"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066539    2546 flags.go:64] FLAG: --cpu-manager-policy-options=""
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066544    2546 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066547    2546 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066550    2546 flags.go:64] FLAG: --enable-debugging-handlers="true"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066553    2546 flags.go:64] FLAG: --enable-load-reader="false"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066556    2546 flags.go:64] FLAG: --enable-server="true"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066559    2546 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066563    2546 flags.go:64] FLAG: --event-burst="100"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066566    2546 flags.go:64] FLAG: --event-qps="50"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066569    2546 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066571    2546 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066577    2546 flags.go:64] FLAG: --eviction-hard=""
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066581    2546 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066583    2546 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066586    2546 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Aug 05 16:21:26.072299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066589    2546 flags.go:64] FLAG: --eviction-soft=""
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066592    2546 flags.go:64] FLAG: --eviction-soft-grace-period=""
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066595    2546 flags.go:64] FLAG: --exit-on-lock-contention="false"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066598    2546 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066601    2546 flags.go:64] FLAG: --experimental-mounter-path=""
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066603    2546 flags.go:64] FLAG: --fail-cgroupv1="false"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066606    2546 flags.go:64] FLAG: --fail-swap-on="true"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066609    2546 flags.go:64] FLAG: --feature-gates=""
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066613    2546 flags.go:64] FLAG: --file-check-frequency="20s"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066616    2546 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066619    2546 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066622    2546 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066625    2546 flags.go:64] FLAG: --healthz-port="10248"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066629    2546 flags.go:64] FLAG: --help="false"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066631    2546 flags.go:64] FLAG: --hostname-override="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066634    2546 flags.go:64] FLAG: --housekeeping-interval="10s"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066637    2546 flags.go:64] FLAG: --http-check-frequency="20s"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066640    2546 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066644    2546 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066648    2546 flags.go:64] FLAG: --image-gc-high-threshold="85"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066651    2546 flags.go:64] FLAG: --image-gc-low-threshold="80"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066653    2546 flags.go:64] FLAG: --image-service-endpoint=""
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066656    2546 flags.go:64] FLAG: --kernel-memcg-notification="false"
Aug 05 16:21:26.072922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066659    2546 flags.go:64] FLAG: --kube-api-burst="100"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066662    2546 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066665    2546 flags.go:64] FLAG: --kube-api-qps="50"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066668    2546 flags.go:64] FLAG: --kube-reserved=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066671    2546 flags.go:64] FLAG: --kube-reserved-cgroup=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066675    2546 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066678    2546 flags.go:64] FLAG: --kubelet-cgroups=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066682    2546 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066684    2546 flags.go:64] FLAG: --lock-file=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066687    2546 flags.go:64] FLAG: --log-cadvisor-usage="false"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066690    2546 flags.go:64] FLAG: --log-flush-frequency="5s"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066693    2546 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066698    2546 flags.go:64] FLAG: --log-json-split-stream="false"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066701    2546 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066704    2546 flags.go:64] FLAG: --log-text-split-stream="false"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066707    2546 flags.go:64] FLAG: --logging-format="text"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066710    2546 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066713    2546 flags.go:64] FLAG: --make-iptables-util-chains="true"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066716    2546 flags.go:64] FLAG: --manifest-url=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066719    2546 flags.go:64] FLAG: --manifest-url-header=""
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066723    2546 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066726    2546 flags.go:64] FLAG: --max-open-files="1000000"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066730    2546 flags.go:64] FLAG: --max-pods="110"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066733    2546 flags.go:64] FLAG: --maximum-dead-containers="-1"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066737    2546 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Aug 05 16:21:26.073575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066739    2546 flags.go:64] FLAG: --memory-manager-policy="None"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066742    2546 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066746    2546 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066749    2546 flags.go:64] FLAG: --node-ip="0.0.0.0"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066752    2546 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066764    2546 flags.go:64] FLAG: --node-status-max-images="50"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066768    2546 flags.go:64] FLAG: --node-status-update-frequency="10s"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066771    2546 flags.go:64] FLAG: --oom-score-adj="-999"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066774    2546 flags.go:64] FLAG: --pod-cidr=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066776    2546 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:267c8c33005f5dc3d4121af550b1c396e30e2928a13624d7362adfbfb7f440f8"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066782    2546 flags.go:64] FLAG: --pod-manifest-path=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066784    2546 flags.go:64] FLAG: --pod-max-pids="-1"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066789    2546 flags.go:64] FLAG: --pods-per-core="0"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066792    2546 flags.go:64] FLAG: --port="10250"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066795    2546 flags.go:64] FLAG: --protect-kernel-defaults="false"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066798    2546 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-033bfb8a1ab9f117b"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066802    2546 flags.go:64] FLAG: --qos-reserved=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066805    2546 flags.go:64] FLAG: --read-only-port="10255"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066808    2546 flags.go:64] FLAG: --register-node="true"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066811    2546 flags.go:64] FLAG: --register-with-taints=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066814    2546 flags.go:64] FLAG: --registry-burst="10"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066817    2546 flags.go:64] FLAG: --registry-qps="5"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066820    2546 flags.go:64] FLAG: --reserved-cpus=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066823    2546 flags.go:64] FLAG: --reserved-memory=""
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066826    2546 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Aug 05 16:21:26.074574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066830    2546 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066833    2546 flags.go:64] FLAG: --rotate-certificates="false"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066836    2546 flags.go:64] FLAG: --rotate-server-certificates="false"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066838    2546 flags.go:64] FLAG: --runonce="false"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066841    2546 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066844    2546 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066847    2546 flags.go:64] FLAG: --seccomp-default="false"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066850    2546 flags.go:64] FLAG: --serialize-image-pulls="true"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066853    2546 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066856    2546 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066859    2546 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066863    2546 flags.go:64] FLAG: --storage-driver-password="root"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066865    2546 flags.go:64] FLAG: --storage-driver-secure="false"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066868    2546 flags.go:64] FLAG: --storage-driver-table="stats"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066871    2546 flags.go:64] FLAG: --storage-driver-user="root"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066874    2546 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066877    2546 flags.go:64] FLAG: --sync-frequency="1m0s"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066880    2546 flags.go:64] FLAG: --system-cgroups=""
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066883    2546 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066889    2546 flags.go:64] FLAG: --system-reserved-cgroup=""
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066892    2546 flags.go:64] FLAG: --tls-cert-file=""
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066895    2546 flags.go:64] FLAG: --tls-cipher-suites="[]"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066900    2546 flags.go:64] FLAG: --tls-min-version=""
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066903    2546 flags.go:64] FLAG: --tls-private-key-file=""
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066905    2546 flags.go:64] FLAG: --topology-manager-policy="none"
Aug 05 16:21:26.075258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066908    2546 flags.go:64] FLAG: --topology-manager-policy-options=""
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066911    2546 flags.go:64] FLAG: --topology-manager-scope="container"
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066914    2546 flags.go:64] FLAG: --v="2"
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066918    2546 flags.go:64] FLAG: --version="false"
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066921    2546 flags.go:64] FLAG: --vmodule=""
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066925    2546 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.066928    2546 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067041    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067045    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067048    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067051    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067054    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067057    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067061    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067065    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067067    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067070    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067073    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067075    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067078    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067081    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.075960 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067083    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067086    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067088    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067091    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067093    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067097    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067100    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067103    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067105    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067108    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067110    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067113    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067116    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067119    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067122    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067124    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067127    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067129    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067132    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067134    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.076508 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067137    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067140    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067142    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067145    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067149    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067152    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067155    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067158    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067161    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067163    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067166    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067169    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067171    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067174    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067176    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067179    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067182    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067186    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067189    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067191    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.077002 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067194    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067196    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067199    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067202    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067206    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067209    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067212    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067215    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067217    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067220    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067223    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067227    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067230    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067233    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067236    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067239    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067242    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067245    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067247    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.077506 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067251    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067253    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067256    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067258    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067261    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067263    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067266    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067269    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067271    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067274    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067278    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067280    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067283    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067285    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067288    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067292    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067295    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067298    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067301    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067304    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.077964 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067307    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067310    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067313    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067315    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067318    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.067336    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.067964    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.076215    2546 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.076230    2546 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.077156    2546 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.077164    2546 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077220    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077225    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077229    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077232    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.078468 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077235    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077240    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077244    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077247    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077251    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077254    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077257    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077259    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077262    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077265    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077268    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077271    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077274    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077277    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077280    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077283    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077286    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077289    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077292    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.078874 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077295    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077298    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077301    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077303    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077305    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077308    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077311    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077314    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077317    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077319    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077337    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077340    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077343    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077345    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077348    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077351    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077353    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077356    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077360    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.079338 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077363    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077366    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077369    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077372    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077375    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077378    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077381    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077384    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077386    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077389    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077392    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077395    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077397    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077400    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077402    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077405    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077407    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077410    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077412    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077415    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.079798 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077418    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077420    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077423    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077425    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077428    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077431    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077433    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077436    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077438    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077440    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077443    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077445    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077448    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077451    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077453    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077455    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077458    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077462    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077464    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077467    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.080279 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077470    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077473    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077477    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077480    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077482    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077485    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077487    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077490    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077492    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077495    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077498    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077500    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077503    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077505    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077508    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077511    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.080806 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077514    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.077519    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077635    2546 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077640    2546 feature_gate.go:328] unrecognized feature gate: NewOLM
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077643    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077646    2546 feature_gate.go:328] unrecognized feature gate: OSStreams
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077649    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077651    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077654    2546 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077656    2546 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077659    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077661    2546 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077664    2546 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077666    2546 feature_gate.go:328] unrecognized feature gate: Example
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077669    2546 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Aug 05 16:21:26.081193 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077672    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077675    2546 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077678    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077680    2546 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077683    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077686    2546 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077688    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077691    2546 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077693    2546 feature_gate.go:328] unrecognized feature gate: SignatureStores
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077696    2546 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077698    2546 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077701    2546 feature_gate.go:328] unrecognized feature gate: OVNObservability
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077703    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077706    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077708    2546 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077711    2546 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077714    2546 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077716    2546 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077719    2546 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Aug 05 16:21:26.081579 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077721    2546 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077724    2546 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077726    2546 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077729    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077731    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077734    2546 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077736    2546 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077739    2546 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077742    2546 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077744    2546 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077747    2546 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077749    2546 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077751    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077755    2546 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077759    2546 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077763    2546 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077766    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077770    2546 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077772    2546 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Aug 05 16:21:26.082096 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077775    2546 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077778    2546 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077781    2546 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077784    2546 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077788    2546 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077791    2546 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077794    2546 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077797    2546 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077800    2546 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077802    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077805    2546 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077808    2546 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077810    2546 feature_gate.go:328] unrecognized feature gate: EventTTL
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077812    2546 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077815    2546 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077817    2546 feature_gate.go:328] unrecognized feature gate: DualReplica
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077820    2546 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077822    2546 feature_gate.go:328] unrecognized feature gate: PinnedImages
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077826    2546 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077830    2546 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Aug 05 16:21:26.082574 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077833    2546 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077835    2546 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077838    2546 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077841    2546 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077843    2546 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077846    2546 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077848    2546 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077851    2546 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077862    2546 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077865    2546 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077867    2546 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077870    2546 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077873    2546 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077876    2546 feature_gate.go:328] unrecognized feature gate: Example2
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077878    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077881    2546 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077884    2546 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077886    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077889    2546 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Aug 05 16:21:26.083049 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077891    2546 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077894    2546 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077896    2546 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077899    2546 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077901    2546 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077904    2546 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077907    2546 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077909    2546 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:26.077912    2546 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.077916    2546 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.078016    2546 server.go:962] "Client rotation is on, will bootstrap in background"
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.080127    2546 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.081640    2546 server.go:1019] "Starting client certificate rotation"
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.081739    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:21:26.083514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.081769    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Aug 05 16:21:26.085265 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.085251    2546 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:21:26.086703 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.086686    2546 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Aug 05 16:21:26.096063 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.096048    2546 log.go:25] "Validated CRI v1 runtime API"
Aug 05 16:21:26.098160 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.098144    2546 log.go:25] "Validated CRI v1 image API"
Aug 05 16:21:26.098889 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.098870    2546 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Aug 05 16:21:26.101469 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.101445    2546 fs.go:135] Filesystem UUIDs: map[187c85df-d0e0-4576-a35c-dac55900ff7b:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 c3478968-c3a6-4938-a278-cb94529821e3:/dev/nvme0n1p3]
Aug 05 16:21:26.101518 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.101469    2546 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Aug 05 16:21:26.109288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.109176    2546 manager.go:216] Machine: {Timestamp:2026-08-05 16:21:26.107796009 +0000 UTC m=+0.369106599 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102968 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e231cf97e1f63a89ab476f580691d SystemUUID:ec2e231c-f97e-1f63-a89a-b476f580691d BootID:a76494ee-22ff-4408-8322-1ef0dca746ee Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ce:b6:67:6d:89 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ce:b6:67:6d:89 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:59:ac:bb:15:e6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Aug 05 16:21:26.109288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.109275    2546 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Aug 05 16:21:26.109463 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.109363    2546 manager.go:232] Version: {KernelVersion:5.14.0-570.131.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260727-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Aug 05 16:21:26.112729 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.112703    2546 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Aug 05 16:21:26.112885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.112732    2546 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-153.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Aug 05 16:21:26.113519 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.113507    2546 topology_manager.go:138] "Creating topology manager with none policy"
Aug 05 16:21:26.113579 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.113524    2546 container_manager_linux.go:309] "Creating device plugin manager"
Aug 05 16:21:26.113579 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.113534    2546 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:21:26.114277 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.114264    2546 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Aug 05 16:21:26.115374 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.115363    2546 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Aug 05 16:21:26.117661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.117643    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:21:26.119026 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119013    2546 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:21:26.119150 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119140    2546 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Aug 05 16:21:26.119203 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119176    2546 kubelet.go:486] "Attempting to sync node with API server"
Aug 05 16:21:26.119203 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119190    2546 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Aug 05 16:21:26.119295 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119212    2546 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Aug 05 16:21:26.119295 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119225    2546 kubelet.go:398] "Adding apiserver pod source"
Aug 05 16:21:26.119295 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119236    2546 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Aug 05 16:21:26.119623 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119609    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:21:26.119684 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.119632    2546 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Aug 05 16:21:26.121878 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.121864    2546 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Aug 05 16:21:26.123387 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.123373    2546 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Aug 05 16:21:26.123424 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.123405    2546 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Aug 05 16:21:26.124449 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124437    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Aug 05 16:21:26.124487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124456    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Aug 05 16:21:26.124487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124463    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Aug 05 16:21:26.124487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124468    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Aug 05 16:21:26.124487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124477    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Aug 05 16:21:26.124487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124483    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124491    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124496    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124501    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124507    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124515    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Aug 05 16:21:26.124661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.124522    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Aug 05 16:21:26.125392 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.125381    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Aug 05 16:21:26.125392 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.125392    2546 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Aug 05 16:21:26.128537 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.128520    2546 server.go:1268] "Started kubelet"
Aug 05 16:21:26.128622 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.128591    2546 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Aug 05 16:21:26.128682 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.128593    2546 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Aug 05 16:21:26.128734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.128692    2546 server_v1.go:49] "podresources" method="list" useActivePods=true
Aug 05 16:21:26.129373 ip-10-0-134-153 systemd[1]: Started Kubernetes Kubelet.
Aug 05 16:21:26.130159 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.130142    2546 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Aug 05 16:21:26.130603 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.130589    2546 server.go:310] "Adding debug handlers to kubelet server"
Aug 05 16:21:26.130791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.130773    2546 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-153.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Aug 05 16:21:26.130861 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.130792    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Aug 05 16:21:26.130950 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.130927    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Aug 05 16:21:26.134853 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.134837    2546 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Aug 05 16:21:26.134966 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.134848    2546 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Aug 05 16:21:26.135131 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.135073    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.135987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.135965    2546 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Aug 05 16:21:26.136078 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136059    2546 factory.go:55] Registering systemd factory
Aug 05 16:21:26.136078 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136074    2546 factory.go:223] Registration of the systemd container factory successfully
Aug 05 16:21:26.136503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136356    2546 volume_manager.go:311] "The desired_state_of_world populator starts"
Aug 05 16:21:26.136503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136376    2546 volume_manager.go:313] "Starting Kubelet Volume Manager"
Aug 05 16:21:26.136503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136427    2546 factory.go:153] Registering CRI-O factory
Aug 05 16:21:26.136503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136440    2546 factory.go:223] Registration of the crio container factory successfully
Aug 05 16:21:26.136503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136506    2546 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Aug 05 16:21:26.136733 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136518    2546 reconstruct.go:97] "Volume reconstruction finished"
Aug 05 16:21:26.136733 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136527    2546 reconciler.go:29] "Reconciler: start to sync state"
Aug 05 16:21:26.136733 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136529    2546 factory.go:103] Registering Raw factory
Aug 05 16:21:26.136733 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.136543    2546 manager.go:1196] Started watching for new ooms in manager
Aug 05 16:21:26.137089 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.137063    2546 manager.go:349] Starting recovery of all containers
Aug 05 16:21:26.137211 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.137195    2546 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Aug 05 16:21:26.140210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.140183    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gknbp"
Aug 05 16:21:26.141463 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.141437    2546 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-153.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Aug 05 16:21:26.141597 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.141576    2546 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Aug 05 16:21:26.144902 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.141644    2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-153.ec2.internal.18c8f53b07677957  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-153.ec2.internal,UID:ip-10-0-134-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-153.ec2.internal,},FirstTimestamp:2026-08-05 16:21:26.128499031 +0000 UTC m=+0.389809621,LastTimestamp:2026-08-05 16:21:26.128499031 +0000 UTC m=+0.389809621,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-153.ec2.internal,}"
Aug 05 16:21:26.147153 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.146219    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gknbp"
Aug 05 16:21:26.151145 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.151124    2546 manager.go:354] Recovery completed
Aug 05 16:21:26.155700 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.155689    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.157487 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.157472    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.157547 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.157501    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.157547 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.157512    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.157996    2546 cpu_manager.go:222] "Starting CPU manager" policy="none"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158010    2546 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158027    2546 state_mem.go:36] "Initialized new in-memory state store"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158000    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158785    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158825    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.158836    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.159286    2546 policy_none.go:49] "None policy: Start"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.159300    2546 memory_manager.go:187] "Starting memorymanager" policy="None"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.159313    2546 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Aug 05 16:21:26.160006 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.159685    2546 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-153.ec2.internal.18c8f53b0921ca71  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-153.ec2.internal,UID:ip-10-0-134-153.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-153.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-153.ec2.internal,},FirstTimestamp:2026-08-05 16:21:26.157486705 +0000 UTC m=+0.418797301,LastTimestamp:2026-08-05 16:21:26.157486705 +0000 UTC m=+0.418797301,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-153.ec2.internal,}"
Aug 05 16:21:26.160929 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.160911    2546 policy_none.go:47] "Start"
Aug 05 16:21:26.235601 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.235382    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.302112 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.302074    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Aug 05 16:21:26.303377 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.303354    2546 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Aug 05 16:21:26.303502 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.303394    2546 status_manager.go:244] "Starting to sync pod status with apiserver"
Aug 05 16:21:26.303502 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.303419    2546 kubelet.go:2448] "Starting kubelet main sync loop"
Aug 05 16:21:26.303502 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.303461    2546 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Aug 05 16:21:26.306276 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.306256    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:26.335692 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.335658    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.347749 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.347732    2546 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-153.ec2.internal\" not found" node="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.360907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.360892    2546 manager.go:337] "Starting Device Plugin manager"
Aug 05 16:21:26.361049 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.361026    2546 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Aug 05 16:21:26.361049 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361047    2546 server.go:87] "Starting device plugin registration server"
Aug 05 16:21:26.361376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361364    2546 eviction_manager.go:189] "Eviction manager: starting control loop"
Aug 05 16:21:26.361456 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361391    2546 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Aug 05 16:21:26.361507 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361482    2546 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Aug 05 16:21:26.361618 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361579    2546 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Aug 05 16:21:26.361618 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.361589    2546 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Aug 05 16:21:26.362191 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.362169    2546 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Aug 05 16:21:26.362247 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.362226    2546 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.404370 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.404345    2546 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"]
Aug 05 16:21:26.404505 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.404423    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.406697 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.406680    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.406783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.406713    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.406783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.406740    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.408423 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.408409    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.408554 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.408540    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.408603 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.408575    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.409978 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.409960    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.410072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.409987    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.410072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.409997    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.410072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.409965    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.410072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.410057    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.410072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.410070    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.411454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.411441    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.411505 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.411465    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.412246 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.412227    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.412355 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.412253    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.412355 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.412277    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.433863 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.433836    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-153.ec2.internal\" not found" node="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.438108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.438080    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.438177 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.438123    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.438177 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.438148    2546 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-153.ec2.internal\" not found" node="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.438177 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.438170    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3090c32a53f05cda58fdc9e5efc8d30-config\") pod \"kube-apiserver-proxy-ip-10-0-134-153.ec2.internal\" (UID: \"d3090c32a53f05cda58fdc9e5efc8d30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.462200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.462181    2546 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Aug 05 16:21:26.463097 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.463084    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientMemory"
Aug 05 16:21:26.463151 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.463110    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasNoDiskPressure"
Aug 05 16:21:26.463151 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.463122    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeHasSufficientPID"
Aug 05 16:21:26.463210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.463152    2546 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.472150 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.472134    2546 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.472196 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.472152    2546 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-153.ec2.internal\": node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.485665 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.485643    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.538835 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.538812    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.539213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.538838    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.539213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.539128    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.539213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.539168    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6858633e5e8b564c76f71a69f7d39e36-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal\" (UID: \"6858633e5e8b564c76f71a69f7d39e36\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.539213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.539179    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3090c32a53f05cda58fdc9e5efc8d30-config\") pod \"kube-apiserver-proxy-ip-10-0-134-153.ec2.internal\" (UID: \"d3090c32a53f05cda58fdc9e5efc8d30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.539501 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.539220    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d3090c32a53f05cda58fdc9e5efc8d30-config\") pod \"kube-apiserver-proxy-ip-10-0-134-153.ec2.internal\" (UID: \"d3090c32a53f05cda58fdc9e5efc8d30\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.585951 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.585929    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.686574 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.686539    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.736848 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.736821    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.741698 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:26.741258    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:26.787278 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.787239    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.888087 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.888050    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:26.988662 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:26.988618    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:27.083063 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.083024    2546 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Aug 05 16:21:27.083614 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.083213    2546 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Aug 05 16:21:27.089806 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.089784    2546 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-153.ec2.internal\" not found"
Aug 05 16:21:27.099392 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.099369    2546 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:27.120510 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.120459    2546 apiserver.go:52] "Watching apiserver"
Aug 05 16:21:27.129545 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.129521    2546 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Aug 05 16:21:27.129931 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.129893    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-6kjcp","openshift-cluster-node-tuning-operator/tuned-jwdvk","openshift-dns/node-resolver-rlt9g","openshift-image-registry/node-ca-p6k5l","openshift-multus/multus-9f5hl","openshift-multus/multus-additional-cni-plugins-xzwpp","openshift-network-diagnostics/network-check-target-lkcd8","openshift-network-operator/iptables-alerter-64s8g","kube-system/konnectivity-agent-qc4nf","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8","openshift-multus/network-metrics-daemon-rh8d9","openshift-ovn-kubernetes/ovnkube-node-8qkdk"]
Aug 05 16:21:27.131803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.131787    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.131877 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.131851    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:27.133240 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.133223    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.134565 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.134546    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.135140 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.135122    2546 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Aug 05 16:21:27.135548 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.135496    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:27.135682 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.135566    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.135682 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.135566    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.135682 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.135633    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p64ww\""
Aug 05 16:21:27.136168 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.136152    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.136922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.136890    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jf7qf\""
Aug 05 16:21:27.136922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.136913    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.137088 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.136974    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.137717 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.137702    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.139161 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.139147    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.139714 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.139697    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.139782 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.139746    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.139910 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.139896    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Aug 05 16:21:27.140312 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140297    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Aug 05 16:21:27.140430 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140411    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bcvpm\""
Aug 05 16:21:27.140430 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140303    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.140547 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140437    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.140547 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140305    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Aug 05 16:21:27.140547 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140445    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ccjk8\""
Aug 05 16:21:27.140744 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.140726    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:27.140822 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.140804    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:27.141222 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141209    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2glc4\""
Aug 05 16:21:27.141307 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141212    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Aug 05 16:21:27.141738 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141724    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Aug 05 16:21:27.141831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141810    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-socket-dir-parent\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.141877 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141839    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-multus-certs\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.141877 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141858    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-conf\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.141955 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141881    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-systemd\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.141955 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141897    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0be5ac93-18ef-4053-b0c4-9a0116de7d59-hosts-file\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.141955 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141923    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-cnibin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.141955 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141938    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-os-release\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.141955 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141952    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-etc-kubernetes\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141967    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141982    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-lib-modules\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.141997    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-etc-tuned\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142044    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz9z6\" (UniqueName: \"kubernetes.io/projected/49ee1a41-832a-4022-beaa-88da673049d3-kube-api-access-bz9z6\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142086    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-cni-binary-copy\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142113    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-multus-daemon-config\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142119    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.142346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142141    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be5ac93-18ef-4053-b0c4-9a0116de7d59-tmp-dir\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.142346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142292    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj4ln\" (UniqueName: \"kubernetes.io/projected/78fb5a58-5e23-4e38-9adc-881a59ef49b1-kube-api-access-sj4ln\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.142346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142322    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-conf-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142371    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phj89\" (UniqueName: \"kubernetes.io/projected/d050e2a8-1312-4c1f-8984-301963755175-kube-api-access-phj89\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142401    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-tmp\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142432    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-sys\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142458    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142483    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-bin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142509    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-kubelet\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142563 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142536    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-run\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142564    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrrt7\" (UniqueName: \"kubernetes.io/projected/0be5ac93-18ef-4053-b0c4-9a0116de7d59-kube-api-access-nrrt7\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142598    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142618    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-k8s-cni-cncf-io\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142636    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-netns\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142651    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-multus\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142666    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-hostroot\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142682    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-kubelet-config\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142707    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-dbus\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142761    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-var-lib-kubelet\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142789    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-system-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142811    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-modprobe-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142829    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysconfig\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142870    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-kubernetes\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142891    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-host\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142925    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78fb5a58-5e23-4e38-9adc-881a59ef49b1-host\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.142941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.142944    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78fb5a58-5e23-4e38-9adc-881a59ef49b1-serviceca\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.143525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.143482    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.144401 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.144302    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Aug 05 16:21:27.144704 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.144584    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.144919 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.144892    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.145793 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.145423    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6r27v\""
Aug 05 16:21:27.145793 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.145437    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j6hpc\""
Aug 05 16:21:27.146223 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.146045    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.147178 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.146828    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Aug 05 16:21:27.147178 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.147040    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Aug 05 16:21:27.148001 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.147981    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.148087 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.148048    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:27.148434 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.148411    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Aug 05 16:21:27.148529 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.148454    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.149146 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.149129    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.149265 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.149245    2546 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Aug 05 16:21:27.149697 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.149677    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txbvl\""
Aug 05 16:21:27.150127 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.150111    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.150698 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.150652    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-08-04 16:16:26 +0000 UTC" deadline="2028-04-17 07:51:50.199295266 +0000 UTC"
Aug 05 16:21:27.150698 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.150696    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14895h30m23.048601475s"
Aug 05 16:21:27.152224 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152205    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal"]
Aug 05 16:21:27.152224 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152218    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Aug 05 16:21:27.152344 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152307    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kzc92\""
Aug 05 16:21:27.152635 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152620    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:21:27.152713 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152686    2546 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"
Aug 05 16:21:27.152767 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152751    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Aug 05 16:21:27.152825 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152754    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Aug 05 16:21:27.152997 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.152983    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Aug 05 16:21:27.153072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.153014    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Aug 05 16:21:27.153127 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.153015    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Aug 05 16:21:27.162191 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.162175    2546 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Aug 05 16:21:27.162246 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.162214    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal"]
Aug 05 16:21:27.191028 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.191009    2546 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdd2d"
Aug 05 16:21:27.195982 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.195961    2546 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:27.201831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.201814    2546 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cdd2d"
Aug 05 16:21:27.237072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.237052    2546 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Aug 05 16:21:27.243138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243118    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c996b690-5c12-48cb-8918-a4ca649da788-konnectivity-ca\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.243241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243156    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243183    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.243241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243199    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243216    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-netns\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243232    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-hostroot\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243248    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-dbus\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243275    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-host\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243290    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78fb5a58-5e23-4e38-9adc-881a59ef49b1-host\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243306    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78fb5a58-5e23-4e38-9adc-881a59ef49b1-serviceca\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243350    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243371    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-hostroot\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243409    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rfnc\" (UniqueName: \"kubernetes.io/projected/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-kube-api-access-7rfnc\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243386    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/78fb5a58-5e23-4e38-9adc-881a59ef49b1-host\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243448    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243465    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysconfig\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243491    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-kubernetes\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243503    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-netns\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243503    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-dbus\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243537    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-log-socket\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243569    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysconfig\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243565    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-env-overrides\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243610    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovn-node-metrics-cert\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243573    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-kubernetes\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243646    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-host\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243685    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243743    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9gbw\" (UniqueName: \"kubernetes.io/projected/55712474-83bf-4088-afc1-78e4fbb23079-kube-api-access-l9gbw\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243794    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-socket-dir-parent\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243840    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-multus-certs\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243904    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-socket-dir-parent\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.243974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243953    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-multus-certs\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.243961    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-netns\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244058    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-config\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244090    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-registration-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244130    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-cnibin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244158    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-os-release\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244184    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-lib-modules\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244185    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-cnibin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244212    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-etc-tuned\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244240    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sscv2\" (UniqueName: \"kubernetes.io/projected/698e35ec-9c06-48e2-b8fe-46dcdb55467a-kube-api-access-sscv2\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244254    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-os-release\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244265    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c996b690-5c12-48cb-8918-a4ca649da788-agent-certs\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244292    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244341    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj4ln\" (UniqueName: \"kubernetes.io/projected/78fb5a58-5e23-4e38-9adc-881a59ef49b1-kube-api-access-sj4ln\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244405    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-node-log\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244436    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244465    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-conf-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.244879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244514    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-lib-modules\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244489    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-tmp\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244557    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-multus-conf-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244564    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-iptables-alerter-script\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244664    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-sys-fs\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244700    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-sys\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244724    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-ovn\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244747    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-script-lib\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244767    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-sys\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244774    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-os-release\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244834    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244879    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-device-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244922    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-bin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244947    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-kubelet\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244970    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-run\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245009    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrrt7\" (UniqueName: \"kubernetes.io/projected/0be5ac93-18ef-4053-b0c4-9a0116de7d59-kube-api-access-nrrt7\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.245535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.244980    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-bin\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245072    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-socket-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245081    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-run\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245071    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-kubelet\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245097    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-systemd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245074    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/78fb5a58-5e23-4e38-9adc-881a59ef49b1-serviceca\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245125    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-k8s-cni-cncf-io\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245147    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-multus\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245200    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-kubelet-config\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245229    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-var-lib-kubelet\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245222    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-run-k8s-cni-cncf-io\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245252    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-host-var-lib-cni-multus\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245274    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/08792d7f-edb3-4507-96d9-f6cfd3288774-kubelet-config\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245259    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-system-cni-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245287    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-var-lib-kubelet\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245307    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cnibin\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245367    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-system-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.246337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245393    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-system-cni-dir\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245419    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-modprobe-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245461    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-netd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245513    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-modprobe-d\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245528    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245586    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245624    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-conf\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245684    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-systemd\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245683    2546 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245728    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0be5ac93-18ef-4053-b0c4-9a0116de7d59-hosts-file\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245755    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-var-lib-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245783    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj529\" (UniqueName: \"kubernetes.io/projected/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-kube-api-access-qj529\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245784    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-sysctl-conf\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245785    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/49ee1a41-832a-4022-beaa-88da673049d3-etc-systemd\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245823    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-etc-kubernetes\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245822    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0be5ac93-18ef-4053-b0c4-9a0116de7d59-hosts-file\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245851    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.247130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.245876    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d050e2a8-1312-4c1f-8984-301963755175-etc-kubernetes\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246001    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz9z6\" (UniqueName: \"kubernetes.io/projected/49ee1a41-832a-4022-beaa-88da673049d3-kube-api-access-bz9z6\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246065    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-systemd-units\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246107    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.246126    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246149    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-etc-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246198    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-cni-binary-copy\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246237    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-multus-daemon-config\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246306    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be5ac93-18ef-4053-b0c4-9a0116de7d59-tmp-dir\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.246327    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.746288265 +0000 UTC m=+2.007598861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246397    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cqcq\" (UniqueName: \"kubernetes.io/projected/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-kube-api-access-7cqcq\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246438    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-kubelet\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246464    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-slash\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246505    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-bin\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246540    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phj89\" (UniqueName: \"kubernetes.io/projected/d050e2a8-1312-4c1f-8984-301963755175-kube-api-access-phj89\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246564    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-host-slash\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.247810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246589    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.248320 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246619    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.248320 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.246794    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-cni-binary-copy\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.248320 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.247138    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d050e2a8-1312-4c1f-8984-301963755175-multus-daemon-config\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.248320 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.247199    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0be5ac93-18ef-4053-b0c4-9a0116de7d59-tmp-dir\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.249114 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.249089    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-tmp\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.249171 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.249156    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/49ee1a41-832a-4022-beaa-88da673049d3-etc-tuned\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.255189 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.255161    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrrt7\" (UniqueName: \"kubernetes.io/projected/0be5ac93-18ef-4053-b0c4-9a0116de7d59-kube-api-access-nrrt7\") pod \"node-resolver-rlt9g\" (UID: \"0be5ac93-18ef-4053-b0c4-9a0116de7d59\") " pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.257336 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.256775    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phj89\" (UniqueName: \"kubernetes.io/projected/d050e2a8-1312-4c1f-8984-301963755175-kube-api-access-phj89\") pod \"multus-9f5hl\" (UID: \"d050e2a8-1312-4c1f-8984-301963755175\") " pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.257336 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.256819    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz9z6\" (UniqueName: \"kubernetes.io/projected/49ee1a41-832a-4022-beaa-88da673049d3-kube-api-access-bz9z6\") pod \"tuned-jwdvk\" (UID: \"49ee1a41-832a-4022-beaa-88da673049d3\") " pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.258301 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.258268    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj4ln\" (UniqueName: \"kubernetes.io/projected/78fb5a58-5e23-4e38-9adc-881a59ef49b1-kube-api-access-sj4ln\") pod \"node-ca-p6k5l\" (UID: \"78fb5a58-5e23-4e38-9adc-881a59ef49b1\") " pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.347121 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347080    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj529\" (UniqueName: \"kubernetes.io/projected/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-kube-api-access-qj529\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347131    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-systemd-units\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347149    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347167    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-etc-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347189    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cqcq\" (UniqueName: \"kubernetes.io/projected/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-kube-api-access-7cqcq\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347213    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-kubelet\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347209    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-systemd-units\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347238    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-etc-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347240    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-slash\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347274    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-kubelet\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347279    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-slash\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347216    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347293    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-bin\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347321    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-bin\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347321    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-host-slash\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347368    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347374    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-host-slash\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347426    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.347439    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347471    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c996b690-5c12-48cb-8918-a4ca649da788-konnectivity-ca\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347501    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.347520    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.847501158 +0000 UTC m=+2.108811735 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347474    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347544    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347584    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rfnc\" (UniqueName: \"kubernetes.io/projected/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-kube-api-access-7rfnc\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347614    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-log-socket\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347636    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-env-overrides\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347660    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovn-node-metrics-cert\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.347807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347687    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347659    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-log-socket\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347715    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9gbw\" (UniqueName: \"kubernetes.io/projected/55712474-83bf-4088-afc1-78e4fbb23079-kube-api-access-l9gbw\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347743    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-netns\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347785    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-config\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347811    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-registration-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347840    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sscv2\" (UniqueName: \"kubernetes.io/projected/698e35ec-9c06-48e2-b8fe-46dcdb55467a-kube-api-access-sscv2\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347865    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-run-netns\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347887    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c996b690-5c12-48cb-8918-a4ca649da788-agent-certs\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347912    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347945    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-registration-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347958    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-node-log\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.347990    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348036    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-iptables-alerter-script\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348086    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348115    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-sys-fs\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348142    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-ovn\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.348705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348172    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-script-lib\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348195    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-os-release\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348221    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/c996b690-5c12-48cb-8918-a4ca649da788-konnectivity-ca\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348219    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-env-overrides\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348269    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348307    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-device-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348345    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-socket-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348373    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-systemd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348420    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348423    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-system-cni-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348458    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-system-cni-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348302    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-sys-fs\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348474    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-device-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348497    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cnibin\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348530    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-netd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348565    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348586    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-socket-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348595    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348348    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-ovn\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348586    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-config\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348640    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-node-log\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348667    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-host-cni-netd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348698    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-var-lib-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348693    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cnibin\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348728    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-os-release\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348768    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-run-systemd\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348819    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-etc-selinux\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348861    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348863    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovnkube-script-lib\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348905    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/698e35ec-9c06-48e2-b8fe-46dcdb55467a-var-lib-openvswitch\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.348968    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55712474-83bf-4088-afc1-78e4fbb23079-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.349243    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-cni-binary-copy\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.349268    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-iptables-alerter-script\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.349923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.349543    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.350731 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.350707    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/c996b690-5c12-48cb-8918-a4ca649da788-agent-certs\") pod \"konnectivity-agent-qc4nf\" (UID: \"c996b690-5c12-48cb-8918-a4ca649da788\") " pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.350834 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.350731    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/698e35ec-9c06-48e2-b8fe-46dcdb55467a-ovn-node-metrics-cert\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.357924 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.357907    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:27.358006 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.357928    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:27.358006 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.357938    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:27.358006 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.357999    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:27.857984053 +0000 UTC m=+2.119294634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:27.359762 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.359727    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rfnc\" (UniqueName: \"kubernetes.io/projected/e6e4860e-58fa-4bd8-a20e-4dfce184efc4-kube-api-access-7rfnc\") pod \"iptables-alerter-64s8g\" (UID: \"e6e4860e-58fa-4bd8-a20e-4dfce184efc4\") " pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.361022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.361003    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cqcq\" (UniqueName: \"kubernetes.io/projected/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-kube-api-access-7cqcq\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.362640 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.362621    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sscv2\" (UniqueName: \"kubernetes.io/projected/698e35ec-9c06-48e2-b8fe-46dcdb55467a-kube-api-access-sscv2\") pod \"ovnkube-node-8qkdk\" (UID: \"698e35ec-9c06-48e2-b8fe-46dcdb55467a\") " pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.363024 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.363000    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj529\" (UniqueName: \"kubernetes.io/projected/5dbabd7d-5595-4639-97ab-2e7fa4f08d87-kube-api-access-qj529\") pod \"multus-additional-cni-plugins-xzwpp\" (UID: \"5dbabd7d-5595-4639-97ab-2e7fa4f08d87\") " pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.365561 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.365539    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9gbw\" (UniqueName: \"kubernetes.io/projected/55712474-83bf-4088-afc1-78e4fbb23079-kube-api-access-l9gbw\") pod \"aws-ebs-csi-driver-node-5lts8\" (UID: \"55712474-83bf-4088-afc1-78e4fbb23079\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.467171 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.467078    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jwdvk"
Aug 05 16:21:27.489683 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.489621    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rlt9g"
Aug 05 16:21:27.508356 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.508301    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p6k5l"
Aug 05 16:21:27.510567 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.510398    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9f5hl"
Aug 05 16:21:27.544454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.544415    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xzwpp"
Aug 05 16:21:27.548756 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.548739    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-64s8g"
Aug 05 16:21:27.583454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.583427    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:27.596292 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.596273    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8"
Aug 05 16:21:27.601553 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.601533    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:27.666998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.666973    2546 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:27.752002 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.751920    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:27.752218 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.752047    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.752218 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.752117    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:28.752101594 +0000 UTC m=+3.013412172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:27.852285 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.852258    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:27.852413 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.852386    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.852460 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.852450    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:28.852434366 +0000 UTC m=+3.113744943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:27.864035 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.864004    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6858633e5e8b564c76f71a69f7d39e36.slice/crio-0ad5d7a6a7f96466cf34538d083cef9ffd2e2c72f2b6f3048eeb02184b20d64c WatchSource:0}: Error finding container 0ad5d7a6a7f96466cf34538d083cef9ffd2e2c72f2b6f3048eeb02184b20d64c: Status 404 returned error can't find the container with id 0ad5d7a6a7f96466cf34538d083cef9ffd2e2c72f2b6f3048eeb02184b20d64c
Aug 05 16:21:27.864298 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.864276    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3090c32a53f05cda58fdc9e5efc8d30.slice/crio-ceba4cf11d4ff8ce59861062c18afa753d8a2ce94280a16f49781b60bbc34505 WatchSource:0}: Error finding container ceba4cf11d4ff8ce59861062c18afa753d8a2ce94280a16f49781b60bbc34505: Status 404 returned error can't find the container with id ceba4cf11d4ff8ce59861062c18afa753d8a2ce94280a16f49781b60bbc34505
Aug 05 16:21:27.871005 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.870989    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:21:27.880124 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.880093    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78fb5a58_5e23_4e38_9adc_881a59ef49b1.slice/crio-720ca01d5800f4ae35aded6c31d4322daf4b393f15b8d3a15512dc81eeab7ebe WatchSource:0}: Error finding container 720ca01d5800f4ae35aded6c31d4322daf4b393f15b8d3a15512dc81eeab7ebe: Status 404 returned error can't find the container with id 720ca01d5800f4ae35aded6c31d4322daf4b393f15b8d3a15512dc81eeab7ebe
Aug 05 16:21:27.884188 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.884131    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ee1a41_832a_4022_beaa_88da673049d3.slice/crio-6e435b73560ac60c54e5bbbcb377b039167583095b65c16307ea8f331ac2f509 WatchSource:0}: Error finding container 6e435b73560ac60c54e5bbbcb377b039167583095b65c16307ea8f331ac2f509: Status 404 returned error can't find the container with id 6e435b73560ac60c54e5bbbcb377b039167583095b65c16307ea8f331ac2f509
Aug 05 16:21:27.905978 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.905953    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc996b690_5c12_48cb_8918_a4ca649da788.slice/crio-5dcf9d8d6791f2f4c84f27c0775e53bd262b185b5eb1444b7cd4d4e0766b7b84 WatchSource:0}: Error finding container 5dcf9d8d6791f2f4c84f27c0775e53bd262b185b5eb1444b7cd4d4e0766b7b84: Status 404 returned error can't find the container with id 5dcf9d8d6791f2f4c84f27c0775e53bd262b185b5eb1444b7cd4d4e0766b7b84
Aug 05 16:21:27.942740 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.942718    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd050e2a8_1312_4c1f_8984_301963755175.slice/crio-38701370d4c1a015c058264d6d78d8836d21437ed937120dc6cde4277e04adee WatchSource:0}: Error finding container 38701370d4c1a015c058264d6d78d8836d21437ed937120dc6cde4277e04adee: Status 404 returned error can't find the container with id 38701370d4c1a015c058264d6d78d8836d21437ed937120dc6cde4277e04adee
Aug 05 16:21:27.953208 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:27.953184    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:27.953364 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.953348    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:27.953431 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.953368    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:27.953431 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.953378    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:27.953431 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:27.953424    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:28.953408667 +0000 UTC m=+3.214719248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:27.979256 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:27.979233    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dbabd7d_5595_4639_97ab_2e7fa4f08d87.slice/crio-99bbbd41864f303f67ba6a70532fb55e50cac70a15a02a784f56c92ee7befbcd WatchSource:0}: Error finding container 99bbbd41864f303f67ba6a70532fb55e50cac70a15a02a784f56c92ee7befbcd: Status 404 returned error can't find the container with id 99bbbd41864f303f67ba6a70532fb55e50cac70a15a02a784f56c92ee7befbcd
Aug 05 16:21:28.017878 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:28.017852    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698e35ec_9c06_48e2_b8fe_46dcdb55467a.slice/crio-6b967c426e041783a8d629972a3c5987ef0b0def30a7066e10ffb594becdc794 WatchSource:0}: Error finding container 6b967c426e041783a8d629972a3c5987ef0b0def30a7066e10ffb594becdc794: Status 404 returned error can't find the container with id 6b967c426e041783a8d629972a3c5987ef0b0def30a7066e10ffb594becdc794
Aug 05 16:21:28.059673 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:28.059644    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6e4860e_58fa_4bd8_a20e_4dfce184efc4.slice/crio-da4151783e658c282bbb4175a461421afe5830ea51343d1201c5c4577f4d5ed7 WatchSource:0}: Error finding container da4151783e658c282bbb4175a461421afe5830ea51343d1201c5c4577f4d5ed7: Status 404 returned error can't find the container with id da4151783e658c282bbb4175a461421afe5830ea51343d1201c5c4577f4d5ed7
Aug 05 16:21:28.205253 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.205189    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:16:27 +0000 UTC" deadline="2028-01-12 01:15:18.136277522 +0000 UTC"
Aug 05 16:21:28.205253 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.205241    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12584h53m49.931039502s"
Aug 05 16:21:28.257126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.257097    2546 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Aug 05 16:21:28.274460 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:28.274433    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55712474_83bf_4088_afc1_78e4fbb23079.slice/crio-8a54d08d8990e44040995b74427c034b0dd958c05f6065127830567438805f2d WatchSource:0}: Error finding container 8a54d08d8990e44040995b74427c034b0dd958c05f6065127830567438805f2d: Status 404 returned error can't find the container with id 8a54d08d8990e44040995b74427c034b0dd958c05f6065127830567438805f2d
Aug 05 16:21:28.303954 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.303923    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:28.304116 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.304036    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:28.304116 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.304090    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:28.304248 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.304191    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:28.308511 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.308412    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"6b967c426e041783a8d629972a3c5987ef0b0def30a7066e10ffb594becdc794"}
Aug 05 16:21:28.309790 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.309765    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerStarted","Data":"99bbbd41864f303f67ba6a70532fb55e50cac70a15a02a784f56c92ee7befbcd"}
Aug 05 16:21:28.311174 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.311140    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9f5hl" event={"ID":"d050e2a8-1312-4c1f-8984-301963755175","Type":"ContainerStarted","Data":"38701370d4c1a015c058264d6d78d8836d21437ed937120dc6cde4277e04adee"}
Aug 05 16:21:28.314892 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.314855    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jwdvk" event={"ID":"49ee1a41-832a-4022-beaa-88da673049d3","Type":"ContainerStarted","Data":"6e435b73560ac60c54e5bbbcb377b039167583095b65c16307ea8f331ac2f509"}
Aug 05 16:21:28.316539 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.316494    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal" event={"ID":"6858633e5e8b564c76f71a69f7d39e36","Type":"ContainerStarted","Data":"0ad5d7a6a7f96466cf34538d083cef9ffd2e2c72f2b6f3048eeb02184b20d64c"}
Aug 05 16:21:28.317722 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:21:28.317692    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5ac93_18ef_4053_b0c4_9a0116de7d59.slice/crio-4fd9e0f1cb8a99a837f43a8abee3c1d8f6e59e97b7d3a01c4ee5c19451000a27 WatchSource:0}: Error finding container 4fd9e0f1cb8a99a837f43a8abee3c1d8f6e59e97b7d3a01c4ee5c19451000a27: Status 404 returned error can't find the container with id 4fd9e0f1cb8a99a837f43a8abee3c1d8f6e59e97b7d3a01c4ee5c19451000a27
Aug 05 16:21:28.317970 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.317947    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal" event={"ID":"d3090c32a53f05cda58fdc9e5efc8d30","Type":"ContainerStarted","Data":"ceba4cf11d4ff8ce59861062c18afa753d8a2ce94280a16f49781b60bbc34505"}
Aug 05 16:21:28.319221 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.319202    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8" event={"ID":"55712474-83bf-4088-afc1-78e4fbb23079","Type":"ContainerStarted","Data":"8a54d08d8990e44040995b74427c034b0dd958c05f6065127830567438805f2d"}
Aug 05 16:21:28.320639 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.320603    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64s8g" event={"ID":"e6e4860e-58fa-4bd8-a20e-4dfce184efc4","Type":"ContainerStarted","Data":"da4151783e658c282bbb4175a461421afe5830ea51343d1201c5c4577f4d5ed7"}
Aug 05 16:21:28.321662 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.321640    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qc4nf" event={"ID":"c996b690-5c12-48cb-8918-a4ca649da788","Type":"ContainerStarted","Data":"5dcf9d8d6791f2f4c84f27c0775e53bd262b185b5eb1444b7cd4d4e0766b7b84"}
Aug 05 16:21:28.322833 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.322812    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6k5l" event={"ID":"78fb5a58-5e23-4e38-9adc-881a59ef49b1","Type":"ContainerStarted","Data":"720ca01d5800f4ae35aded6c31d4322daf4b393f15b8d3a15512dc81eeab7ebe"}
Aug 05 16:21:28.760263 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.760210    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:28.760485 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.760421    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:28.760572 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.760498    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:30.760475762 +0000 UTC m=+5.021786382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:28.860995 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.860957    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:28.861222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.861097    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:28.861222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.861161    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:30.861141124 +0000 UTC m=+5.122451705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:28.962425 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:28.961749    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:28.962425 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.961959    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:28.962425 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.961984    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:28.962425 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.962001    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:28.962425 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:28.962062    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:30.962042434 +0000 UTC m=+5.223353029 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:29.206690 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:29.206636    2546 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-08-04 16:16:27 +0000 UTC" deadline="2028-01-27 01:08:53.244823953 +0000 UTC"
Aug 05 16:21:29.206690 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:29.206677    2546 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12944h47m24.038151724s"
Aug 05 16:21:29.304738 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:29.304703    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:29.304940 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:29.304856    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:29.339251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:29.339206    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlt9g" event={"ID":"0be5ac93-18ef-4053-b0c4-9a0116de7d59","Type":"ContainerStarted","Data":"4fd9e0f1cb8a99a837f43a8abee3c1d8f6e59e97b7d3a01c4ee5c19451000a27"}
Aug 05 16:21:30.306576 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:30.306547    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:30.307065 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.306697    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:30.307249 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:30.307228    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:30.307426 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.307357    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:30.781801 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:30.781755    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:30.781998 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.781932    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:30.782061 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.782000    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:34.781982026 +0000 UTC m=+9.043292619 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:30.883326 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:30.882628    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:30.883326 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.882798    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:30.883326 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.882885    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:34.882850771 +0000 UTC m=+9.144161353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:30.984757 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:30.984708    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:30.984936 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.984886    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:30.984936 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.984908    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:30.984936 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.984921    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:30.985101 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:30.984980    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:34.984959975 +0000 UTC m=+9.246270573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:31.304889 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:31.304230    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:31.304889 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:31.304413    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:32.304275 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:32.303955    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:32.304275 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:32.303997    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:32.304275 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:32.304117    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:32.304275 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:32.304255    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:33.303863 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:33.303812    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:33.304078 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:33.304006    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:34.304944 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:34.304911    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:34.305455 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.305074    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:34.305455 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:34.304911    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:34.305609 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.305542    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:34.817000 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:34.816816    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:34.817176 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.817011    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:34.817176 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.817100    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:42.817074292 +0000 UTC m=+17.078384871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:34.918324 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:34.918284    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:34.918518 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.918469    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:34.918598 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:34.918559    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:42.91853526 +0000 UTC m=+17.179845843 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:35.019102 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:35.019017    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:35.019277 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:35.019213    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:35.019277 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:35.019243    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:35.019277 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:35.019256    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:35.019471 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:35.019333    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:43.019309435 +0000 UTC m=+17.280620035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:35.304533 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:35.304439    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:35.304701 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:35.304638    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:36.305458 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:36.305423    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:36.305879 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:36.305544    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:36.305879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:36.305603    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:36.305879 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:36.305678    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:37.304077 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:37.303811    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:37.304077 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:37.303952    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:38.304267 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:38.304187    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:38.304726 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:38.304315    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:38.304726 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:38.304358    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:38.304726 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:38.304460    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:39.303809 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:39.303617    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:39.304000 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:39.303911    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:40.303876 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:40.303841    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:40.304253 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:40.303842    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:40.304253 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:40.303984    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:40.304253 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:40.304100    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:41.304523 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:41.304489    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:41.305001 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:41.304614    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:42.304362 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:42.304302    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:42.304531 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.304475    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:42.304531 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:42.304299    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:42.304887 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.304596    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:42.882533 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:42.882500    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:42.882733 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.882663    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:42.882788 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.882735    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:58.882716276 +0000 UTC m=+33.144026876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:42.983937 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:42.983900    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:42.984112 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.984072    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:42.984159 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:42.984146    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:58.984127929 +0000 UTC m=+33.245438507 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:43.084703 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:43.084667    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:43.084879 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:43.084823    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:43.084879 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:43.084841    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:43.084879 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:43.084857    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:43.085009 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:43.084913    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:21:59.084896963 +0000 UTC m=+33.346207561 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:43.304579 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:43.304487    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:43.304736 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:43.304609    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:44.303849 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:44.303817    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:44.304031 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:44.303830    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:44.304031 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:44.303926    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:44.304367 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:44.304337    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:45.303801 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:45.303762    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:45.304240 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:45.303900    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:46.305578 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:46.305527    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:46.305578 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:46.305566    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:46.306119 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:46.305652    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:46.306119 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:46.305748    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:47.304525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:47.304490    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:47.304697 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:47.304612    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:48.304946 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.304906    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:48.305369 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:48.305029    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:48.305369 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.304913    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:48.305369 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:48.305143    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:48.398818 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.398616    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jwdvk" event={"ID":"49ee1a41-832a-4022-beaa-88da673049d3","Type":"ContainerStarted","Data":"e9d9cd96f8792f0c0e59ef101c2679ae3e4f3b679c25b8dff58f11dc09875040"}
Aug 05 16:21:48.408009 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.407753    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal" event={"ID":"d3090c32a53f05cda58fdc9e5efc8d30","Type":"ContainerStarted","Data":"d00402340af8b92eda55745697527944e9952821450a00f237d3195930ab0f6a"}
Aug 05 16:21:48.412559 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.412533    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"f0129d4979c75ba1f8e310d31133bd1e9abc1711e0f9d753ae83cfa5b2b8a5c1"}
Aug 05 16:21:48.412656 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.412612    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"60ef3f53eaa873f5c611639b510b00719d89152c527001855f8c36a46424235b"}
Aug 05 16:21:48.414443 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.414420    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9f5hl" event={"ID":"d050e2a8-1312-4c1f-8984-301963755175","Type":"ContainerStarted","Data":"35b27003eb14ddd3e73ed5e85724e152283398cf4ec714b7c55becf43d9036a8"}
Aug 05 16:21:48.433924 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.433778    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jwdvk" podStartSLOduration=1.189930939 podStartE2EDuration="21.433764346s" totalImagesPullingTime="20.243833407s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:48.419470592 +0000 UTC m=+22.680781189" watchObservedRunningTime="2026-08-05 16:21:48.433764346 +0000 UTC m=+22.695074942"
Aug 05 16:21:48.454395 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.454344    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-153.ec2.internal" podStartSLOduration=21.454315154 podStartE2EDuration="21.454315154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:48.433873468 +0000 UTC m=+22.695184069" watchObservedRunningTime="2026-08-05 16:21:48.454315154 +0000 UTC m=+22.715625753"
Aug 05 16:21:48.454585 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:48.454565    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9f5hl" podStartSLOduration=1.202086448 podStartE2EDuration="21.454559127s" totalImagesPullingTime="20.252472679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:48.45398356 +0000 UTC m=+22.715294158" watchObservedRunningTime="2026-08-05 16:21:48.454559127 +0000 UTC m=+22.715869725"
Aug 05 16:21:49.303738 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.303696    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:49.303908 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:49.303837    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:49.420252 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.420214    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"132281dea9a8a83a5c9e5f938fa45daf1fe02ce689b2fae3403ca62f36ca2d5c"}
Aug 05 16:21:49.421056 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.420305    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"8ee88a98a586785d57a7a7f45a25fc6b8686fe21e5f23b54f4dcb3305333731d"}
Aug 05 16:21:49.421056 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.420373    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"b17daec9721617143a494d758c076ea371276309e05c70d74542494d4338af59"}
Aug 05 16:21:49.421056 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.420413    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"52a70eb806d2e83672078ba4483d040cdff53c418f36af4ea7e4dbe5ca79054a"}
Aug 05 16:21:49.422015 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.421975    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="c375cb14bdc77b42c1459f36ac49be1fd3d0c98e0e16a9e557d9370b795d475a" exitCode=0
Aug 05 16:21:49.422132 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.422017    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"c375cb14bdc77b42c1459f36ac49be1fd3d0c98e0e16a9e557d9370b795d475a"}
Aug 05 16:21:49.425929 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.425724    2546 generic.go:356] "Generic (PLEG): container finished" podID="6858633e5e8b564c76f71a69f7d39e36" containerID="cbcfa8279bea1fcca8dea457c00b15f1f0803f1b3c02d11319ca1f8460a3c67e" exitCode=0
Aug 05 16:21:49.426038 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.425788    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal" event={"ID":"6858633e5e8b564c76f71a69f7d39e36","Type":"ContainerDied","Data":"cbcfa8279bea1fcca8dea457c00b15f1f0803f1b3c02d11319ca1f8460a3c67e"}
Aug 05 16:21:49.427961 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.427935    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8" event={"ID":"55712474-83bf-4088-afc1-78e4fbb23079","Type":"ContainerStarted","Data":"8aa2c7a6be6d5f70ae894ed77ff5af5c760c99abbf19c952f5d590d78353b5cd"}
Aug 05 16:21:49.429551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.429530    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qc4nf" event={"ID":"c996b690-5c12-48cb-8918-a4ca649da788","Type":"ContainerStarted","Data":"b367f3240759e2834db6eacdc571e06a056da160678413715692e5111d4c3a78"}
Aug 05 16:21:49.431107 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.431079    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p6k5l" event={"ID":"78fb5a58-5e23-4e38-9adc-881a59ef49b1","Type":"ContainerStarted","Data":"78a612ea4cb7d23d5ec727b9f5b7cf8cf90228fb7d05f42f047649ddc5c031ca"}
Aug 05 16:21:49.432471 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.432449    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rlt9g" event={"ID":"0be5ac93-18ef-4053-b0c4-9a0116de7d59","Type":"ContainerStarted","Data":"bfc90b6c835f8c65910e57693ce1f3b38a7ec403a38e987ea969df07835f016f"}
Aug 05 16:21:49.460726 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.460683    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rlt9g" podStartSLOduration=2.651091744 podStartE2EDuration="22.460669224s" totalImagesPullingTime="19.80957748s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:49.460036827 +0000 UTC m=+23.721347427" watchObservedRunningTime="2026-08-05 16:21:49.460669224 +0000 UTC m=+23.721979821"
Aug 05 16:21:49.530883 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.530675    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p6k5l" podStartSLOduration=2.285788943 podStartE2EDuration="22.530658004s" totalImagesPullingTime="20.244869061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:49.48151653 +0000 UTC m=+23.742827128" watchObservedRunningTime="2026-08-05 16:21:49.530658004 +0000 UTC m=+23.791968601"
Aug 05 16:21:49.548729 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:49.548688    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qc4nf" podStartSLOduration=10.260359887 podStartE2EDuration="22.548673217s" totalImagesPullingTime="12.28831333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:49.548380415 +0000 UTC m=+23.809691016" watchObservedRunningTime="2026-08-05 16:21:49.548673217 +0000 UTC m=+23.809983814"
Aug 05 16:21:50.125429 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.125285    2546 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Aug 05 16:21:50.304730 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.304660    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:50.304878 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:50.304787    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:50.304878 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.304833    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:50.304948 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:50.304926    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:50.373346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.373182    2546 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-08-05T16:21:50.125314766Z","UUID":"ed0f047f-7ade-4531-890f-ee00aea3fad9","Handler":null,"Name":"","Endpoint":""}
Aug 05 16:21:50.374791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.374771    2546 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Aug 05 16:21:50.374907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.374809    2546 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Aug 05 16:21:50.437022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.436984    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8" event={"ID":"55712474-83bf-4088-afc1-78e4fbb23079","Type":"ContainerStarted","Data":"d8b8ef8d7a3b0a152932b3b19f535573474b04725af38351d018b20efc96ea78"}
Aug 05 16:21:50.438803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.438775    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-64s8g" event={"ID":"e6e4860e-58fa-4bd8-a20e-4dfce184efc4","Type":"ContainerStarted","Data":"a282caa0e65eb14cb33b7e8191cf751ebbe246c7d6989835bcaed8ffb5492672"}
Aug 05 16:21:50.440729 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.440701    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal" event={"ID":"6858633e5e8b564c76f71a69f7d39e36","Type":"ContainerStarted","Data":"22c3728ce812e0f5fbac24680b9706764e57b897913e913345c7b945376c6047"}
Aug 05 16:21:50.470739 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.470685    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-64s8g" podStartSLOduration=3.404064827 podStartE2EDuration="23.470666153s" totalImagesPullingTime="20.066601326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:50.455816408 +0000 UTC m=+24.717127032" watchObservedRunningTime="2026-08-05 16:21:50.470666153 +0000 UTC m=+24.731976750"
Aug 05 16:21:50.471165 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:50.471131    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-153.ec2.internal" podStartSLOduration=23.471121818 podStartE2EDuration="23.471121818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:50.470805993 +0000 UTC m=+24.732116577" watchObservedRunningTime="2026-08-05 16:21:50.471121818 +0000 UTC m=+24.732432451"
Aug 05 16:21:51.304248 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:51.303790    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:51.304248 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:51.303926    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:51.447233 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:51.447195    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"b1360b16fe5cf933c05bed3e724d4b31aa38e616c174f5461416e6a39bc37d33"}
Aug 05 16:21:51.449316 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:51.449288    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8" event={"ID":"55712474-83bf-4088-afc1-78e4fbb23079","Type":"ContainerStarted","Data":"e92def511ff30558c58df5145c48c2ed35b6973f09cfa0ebbdf18695e65762b2"}
Aug 05 16:21:51.469714 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:51.469647    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5lts8" podStartSLOduration=2.299004249 podStartE2EDuration="24.46962747s" totalImagesPullingTime="22.170623221s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:51.469217288 +0000 UTC m=+25.730527891" watchObservedRunningTime="2026-08-05 16:21:51.46962747 +0000 UTC m=+25.730938069"
Aug 05 16:21:52.163190 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.163154    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:52.163769 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.163746    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:52.304406 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.304346    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:52.304564 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.304500    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:52.304564 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:52.304508    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:52.304655 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:52.304629    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:52.451695 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.451620    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:52.452070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:52.452026    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qc4nf"
Aug 05 16:21:53.303966 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:53.303926    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:53.304137 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:53.304067    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:54.304025 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.303800    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:54.304676 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.303863    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:54.304676 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:54.304061    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:54.304676 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:54.304137    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:54.458291 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.458260    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" event={"ID":"698e35ec-9c06-48e2-b8fe-46dcdb55467a","Type":"ContainerStarted","Data":"f5c0b191923df6c5d203650afe67ea452ba057385b53b50043759c48603a02ec"}
Aug 05 16:21:54.458601 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.458575    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:54.458764 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.458652    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:54.458764 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.458698    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:54.460396 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.460368    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="2977dac1c17a556b149768242a4093431363cb0c2a23e2b7653b1edbc6268247" exitCode=0
Aug 05 16:21:54.460508 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.460417    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"2977dac1c17a556b149768242a4093431363cb0c2a23e2b7653b1edbc6268247"}
Aug 05 16:21:54.474095 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.474070    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:54.474215 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.474165    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:21:54.486638 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:54.486586    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk" podStartSLOduration=7.356932384 podStartE2EDuration="27.48656877s" totalImagesPullingTime="20.129636386s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:21:54.486536697 +0000 UTC m=+28.747847299" watchObservedRunningTime="2026-08-05 16:21:54.48656877 +0000 UTC m=+28.747879368"
Aug 05 16:21:55.304590 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.304559    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:55.305115 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:55.304703    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:55.774110 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.774080    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh8d9"]
Aug 05 16:21:55.774280 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.774192    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:55.774381 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:55.774303    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:55.774893 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.774874    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6kjcp"]
Aug 05 16:21:55.774990 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.774977    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:55.775083 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:55.775067    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:55.776692 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.776670    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lkcd8"]
Aug 05 16:21:55.776798 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:55.776751    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:55.776859 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:55.776831    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:56.466674 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:56.466641    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="cb4bd3d5246ef2a3bc7bfd079414dd764a7b2d2752f316e3d87d2f90a020115b" exitCode=0
Aug 05 16:21:56.467217 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:56.466725    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"cb4bd3d5246ef2a3bc7bfd079414dd764a7b2d2752f316e3d87d2f90a020115b"}
Aug 05 16:21:57.304020 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:57.303993    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:57.304160 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:57.304089    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:57.304160 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:57.304094    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:21:57.304243 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:57.304178    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:57.304243 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:57.304096    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:57.304305 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:57.304253    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:58.473551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:58.473519    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="b8de3ed844ae836adea4fd3f4453d153b640794994ddd561e0264f815ef3d89c" exitCode=0
Aug 05 16:21:58.474021 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:58.473575    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"b8de3ed844ae836adea4fd3f4453d153b640794994ddd561e0264f815ef3d89c"}
Aug 05 16:21:58.908206 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:58.908162    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:58.908432 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:58.908355    2546 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:58.908503 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:58.908433    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret podName:08792d7f-edb3-4507-96d9-f6cfd3288774 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:30.908411738 +0000 UTC m=+65.169722328 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret") pod "global-pull-secret-syncer-6kjcp" (UID: "08792d7f-edb3-4507-96d9-f6cfd3288774") : object "kube-system"/"original-pull-secret" not registered
Aug 05 16:21:59.009111 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:59.009075    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:59.009304 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.009219    2546 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:59.009304 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.009285    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs podName:4ed2e991-89b1-40cb-ab9a-1c31a03959e5 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:31.009267903 +0000 UTC m=+65.270578479 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs") pod "network-metrics-daemon-rh8d9" (UID: "4ed2e991-89b1-40cb-ab9a-1c31a03959e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Aug 05 16:21:59.109966 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:59.109935    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:59.110179 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.110063    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Aug 05 16:21:59.110179 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.110079    2546 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Aug 05 16:21:59.110179 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.110088    2546 projected.go:196] Error preparing data for projected volume kube-api-access-sw95t for pod openshift-network-diagnostics/network-check-target-lkcd8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:59.110179 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.110145    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t podName:7226519c-52ae-4657-b24d-8d859930e4d2 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:31.110129856 +0000 UTC m=+65.371440433 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sw95t" (UniqueName: "kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t") pod "network-check-target-lkcd8" (UID: "7226519c-52ae-4657-b24d-8d859930e4d2") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Aug 05 16:21:59.304390 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:59.304288    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:21:59.304527 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:59.304302    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:21:59.304527 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:21:59.304449    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:21:59.304527 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.304446    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lkcd8" podUID="7226519c-52ae-4657-b24d-8d859930e4d2"
Aug 05 16:21:59.304672 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.304575    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6kjcp" podUID="08792d7f-edb3-4507-96d9-f6cfd3288774"
Aug 05 16:21:59.304760 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:21:59.304709    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rh8d9" podUID="4ed2e991-89b1-40cb-ab9a-1c31a03959e5"
Aug 05 16:22:01.043515 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.043229    2546 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-153.ec2.internal" event="NodeReady"
Aug 05 16:22:01.043941 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.043569    2546 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Aug 05 16:22:01.105541 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.105505    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8jgrj"]
Aug 05 16:22:01.108643 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.108617    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-24c8s"]
Aug 05 16:22:01.108779 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.108748    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.110545 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.110524    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.111293 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.111274    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Aug 05 16:22:01.111405 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.111317    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cnw72\""
Aug 05 16:22:01.111561 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.111541    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Aug 05 16:22:01.112883 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.112800    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Aug 05 16:22:01.113149 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.113129    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Aug 05 16:22:01.114159 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.114131    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Aug 05 16:22:01.114363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.114345    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5c2w7\""
Aug 05 16:22:01.121458 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.121436    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24c8s"]
Aug 05 16:22:01.125475 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.125247    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jgrj"]
Aug 05 16:22:01.225741 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225702    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmf66\" (UniqueName: \"kubernetes.io/projected/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-kube-api-access-pmf66\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.225915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225757    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-tmp-dir\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.225915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225787    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-config-volume\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.225915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225812    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgbmq\" (UniqueName: \"kubernetes.io/projected/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-kube-api-access-lgbmq\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.225915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225839    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-cert\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.226096 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.225938    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.303974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.303887    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:22:01.303974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.303920    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:22:01.303974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.303921    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:22:01.306425 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306356    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64w4b\""
Aug 05 16:22:01.306425 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306419    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:22:01.306633 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306437    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:22:01.306633 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306485    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:22:01.306633 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306550    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:22:01.306947 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.306929    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w287q\""
Aug 05 16:22:01.326634 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326607    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmf66\" (UniqueName: \"kubernetes.io/projected/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-kube-api-access-pmf66\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.326749 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326647    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-tmp-dir\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.326749 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326679    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-config-volume\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.326749 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326705    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgbmq\" (UniqueName: \"kubernetes.io/projected/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-kube-api-access-lgbmq\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.326749 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326730    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-cert\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.327004 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.326773    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.327123 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.327091    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-tmp-dir\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.327367 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.327311    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-config-volume\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.327584 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:01.327561    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:01.327687 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:01.327636    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:01.82761523 +0000 UTC m=+36.088925811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:01.332493 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.332467    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-cert\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.338152 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.338133    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmf66\" (UniqueName: \"kubernetes.io/projected/f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea-kube-api-access-pmf66\") pod \"ingress-canary-24c8s\" (UID: \"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea\") " pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.338838 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.338815    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgbmq\" (UniqueName: \"kubernetes.io/projected/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-kube-api-access-lgbmq\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.428476 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.428447    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-24c8s"
Aug 05 16:22:01.831015 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:01.830980    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:01.831197 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:01.831144    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:01.831270 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:01.831217    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:02.83119381 +0000 UTC m=+37.092504386 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:02.450376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:02.450352    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-24c8s"]
Aug 05 16:22:02.452962 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:02.452939    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4d3f46d_b3b5_4cb7_a948_cb0e155f5aea.slice/crio-862b7489adc5e3b8f1635a42b25c65380c306581f8d38a8e6c481e784d769cb5 WatchSource:0}: Error finding container 862b7489adc5e3b8f1635a42b25c65380c306581f8d38a8e6c481e784d769cb5: Status 404 returned error can't find the container with id 862b7489adc5e3b8f1635a42b25c65380c306581f8d38a8e6c481e784d769cb5
Aug 05 16:22:02.484928 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:02.484896    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24c8s" event={"ID":"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea","Type":"ContainerStarted","Data":"862b7489adc5e3b8f1635a42b25c65380c306581f8d38a8e6c481e784d769cb5"}
Aug 05 16:22:02.487854 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:02.487828    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerStarted","Data":"7150908d5f0b6547e795d0d48a9a662d2c9b4664656f4c860b2b4f06c186ebc7"}
Aug 05 16:22:02.839850 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:02.839817    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:02.840041 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:02.839976    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:02.840041 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:02.840042    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:04.840022553 +0000 UTC m=+39.101333146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:03.493024 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:03.492991    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="7150908d5f0b6547e795d0d48a9a662d2c9b4664656f4c860b2b4f06c186ebc7" exitCode=0
Aug 05 16:22:03.493448 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:03.493051    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"7150908d5f0b6547e795d0d48a9a662d2c9b4664656f4c860b2b4f06c186ebc7"}
Aug 05 16:22:04.499743 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:04.499700    2546 generic.go:356] "Generic (PLEG): container finished" podID="5dbabd7d-5595-4639-97ab-2e7fa4f08d87" containerID="c6e5028e6854ef69251ff50d2c39bb0fb15052433042716a595bc6b3a08b085d" exitCode=0
Aug 05 16:22:04.500220 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:04.499756    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerDied","Data":"c6e5028e6854ef69251ff50d2c39bb0fb15052433042716a595bc6b3a08b085d"}
Aug 05 16:22:04.855078 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:04.855036    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:04.855283 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:04.855183    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:04.855283 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:04.855252    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:08.855234086 +0000 UTC m=+43.116544679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:05.505804 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.505768    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" event={"ID":"5dbabd7d-5595-4639-97ab-2e7fa4f08d87","Type":"ContainerStarted","Data":"378533df34823326aaba673feca3015628cd9e3faec75a830e67ab11e8be36df"}
Aug 05 16:22:05.507143 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.507116    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-24c8s" event={"ID":"f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea","Type":"ContainerStarted","Data":"d344849f6de6283e7d2a4cae0cd5a7cc50b5c4d1f510edcc54e5d31a5773c657"}
Aug 05 16:22:05.537599 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.537554    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xzwpp" podStartSLOduration=7.980195995 podStartE2EDuration="38.537539677s" totalImagesPullingTime="30.557343682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:05.535823909 +0000 UTC m=+39.797134519" watchObservedRunningTime="2026-08-05 16:22:05.537539677 +0000 UTC m=+39.798850275"
Aug 05 16:22:05.559615 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.559554    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-24c8s" podStartSLOduration=2.331351295 podStartE2EDuration="4.559539795s" totalImagesPullingTime="2.2281885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:05.558858545 +0000 UTC m=+39.820169143" watchObservedRunningTime="2026-08-05 16:22:05.559539795 +0000 UTC m=+39.820850395"
Aug 05 16:22:05.578706 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.578674    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"]
Aug 05 16:22:05.600879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.600854    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-c6b7r"]
Aug 05 16:22:05.601034 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.600984    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.609616 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.609588    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Aug 05 16:22:05.609750 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.609664    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-klhzd\""
Aug 05 16:22:05.609750 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.609709    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Aug 05 16:22:05.609750 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.609742    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:22:05.610024 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.610009    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Aug 05 16:22:05.610672 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.610654    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-77696685b-2p9n8"]
Aug 05 16:22:05.610823 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.610801    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.612992 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.612974    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Aug 05 16:22:05.613823 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.613800    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-gqg8c\""
Aug 05 16:22:05.614130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.614102    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:22:05.614237 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.614193    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Aug 05 16:22:05.615251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.615226    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Aug 05 16:22:05.623077 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.623059    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Aug 05 16:22:05.625004 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.624987    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"]
Aug 05 16:22:05.625070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.625015    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-2p9n8"]
Aug 05 16:22:05.625110 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.625095    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.628058 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.628042    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Aug 05 16:22:05.628184 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.628163    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-c6b7r"]
Aug 05 16:22:05.629138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.629125    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Aug 05 16:22:05.629503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.629480    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Aug 05 16:22:05.629673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.629655    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Aug 05 16:22:05.629803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.629779    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7qlxs\""
Aug 05 16:22:05.634141 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.634122    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Aug 05 16:22:05.695337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.695294    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"]
Aug 05 16:22:05.710014 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.709980    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:22:05.710014 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.709993    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.712452 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.712431    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Aug 05 16:22:05.712572 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.712473    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Aug 05 16:22:05.712572 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.712488    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-54kcz\""
Aug 05 16:22:05.729368 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.729319    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"]
Aug 05 16:22:05.729481 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.729401    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.731414 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.731393    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:22:05.731414 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.731407    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Aug 05 16:22:05.731705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.731689    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-28g65\""
Aug 05 16:22:05.731903 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.731885    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Aug 05 16:22:05.732166 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.732148    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Aug 05 16:22:05.738783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.738767    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Aug 05 16:22:05.761614 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761585    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-service-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.761714 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761623    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45be7fc4-a472-4a10-96ed-336064a45184-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.761714 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761655    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-trusted-ca\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.761780 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761722    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45be7fc4-a472-4a10-96ed-336064a45184-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.761780 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761746    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-tmp\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.761780 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761766    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v84p9\" (UniqueName: \"kubernetes.io/projected/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-kube-api-access-v84p9\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.761912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761784    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2d8dcf-0136-4937-8245-f28637046bb2-serving-cert\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.761912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761854    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-snapshots\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.761912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761882    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddjh\" (UniqueName: \"kubernetes.io/projected/45be7fc4-a472-4a10-96ed-336064a45184-kube-api-access-jddjh\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.762016 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761910    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-serving-cert\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.762016 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761942    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-config\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.762016 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761966    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9f8lt\" (UniqueName: \"kubernetes.io/projected/eb2d8dcf-0136-4937-8245-f28637046bb2-kube-api-access-9f8lt\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.762016 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.761985    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-trusted-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.862885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.862804    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.862885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.862846    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v84p9\" (UniqueName: \"kubernetes.io/projected/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-kube-api-access-v84p9\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.862885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.862880    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddjh\" (UniqueName: \"kubernetes.io/projected/45be7fc4-a472-4a10-96ed-336064a45184-kube-api-access-jddjh\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.863138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.862897    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-serving-cert\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.863138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.862916    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-config\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.863138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863064    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-trusted-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.863138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863093    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.863138 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863126    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.863363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863153    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45be7fc4-a472-4a10-96ed-336064a45184-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.863363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863170    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-trusted-ca\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.863363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863241    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2d8dcf-0136-4937-8245-f28637046bb2-serving-cert\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.863742 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863280    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-tmp\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.863742 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863625    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.863863 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863822    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-snapshots\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.863912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863856    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.863912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863892    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.864014 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.863941    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fr7n\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.864014 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864005    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9f8lt\" (UniqueName: \"kubernetes.io/projected/eb2d8dcf-0136-4937-8245-f28637046bb2-kube-api-access-9f8lt\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.864112 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864042    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.864112 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864084    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45be7fc4-a472-4a10-96ed-336064a45184-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.864214 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864118    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.864593 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864567    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-trusted-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.864699 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864555    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-trusted-ca\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.864778 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864726    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-service-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.864836 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.864803    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/eb2d8dcf-0136-4937-8245-f28637046bb2-config\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.865186 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.865166    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-service-ca-bundle\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.865474 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.865448    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.865684 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.865269    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-tmp\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.865767 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.865172    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-snapshots\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.865767 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.865606    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/45be7fc4-a472-4a10-96ed-336064a45184-config\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.868756 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.868726    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/45be7fc4-a472-4a10-96ed-336064a45184-serving-cert\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.869185 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.869165    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eb2d8dcf-0136-4937-8245-f28637046bb2-serving-cert\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.869395 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.869377    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-serving-cert\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.874299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.874279    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddjh\" (UniqueName: \"kubernetes.io/projected/45be7fc4-a472-4a10-96ed-336064a45184-kube-api-access-jddjh\") pod \"kube-storage-version-migrator-operator-7878f4b88c-54g4c\" (UID: \"45be7fc4-a472-4a10-96ed-336064a45184\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.876039 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.876017    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v84p9\" (UniqueName: \"kubernetes.io/projected/500f22c1-607f-4cc9-8e24-dad8fcbf5a28-kube-api-access-v84p9\") pod \"insights-operator-77696685b-2p9n8\" (UID: \"500f22c1-607f-4cc9-8e24-dad8fcbf5a28\") " pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.876425 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.876401    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9f8lt\" (UniqueName: \"kubernetes.io/projected/eb2d8dcf-0136-4937-8245-f28637046bb2-kube-api-access-9f8lt\") pod \"console-operator-5ccd6b445f-c6b7r\" (UID: \"eb2d8dcf-0136-4937-8245-f28637046bb2\") " pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.912044 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.912020    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"
Aug 05 16:22:05.923272 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.923254    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:05.933411 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.933385    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-77696685b-2p9n8"
Aug 05 16:22:05.966732 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.966702    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.966848 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.966741    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.966919 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:05.966902    2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:05.966956 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:05.966922    2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcc4c47f9-nwqt6: secret "image-registry-tls" not found
Aug 05 16:22:05.966994 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.966963    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.966994 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:05.966977    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls podName:4450e43b-d942-4ddc-b211-06455dcc8180 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:06.466962625 +0000 UTC m=+40.728273207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls") pod "image-registry-6fcc4c47f9-nwqt6" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180") : secret "image-registry-tls" not found
Aug 05 16:22:05.967084 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967017    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967084 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967044    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967084 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967069    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fr7n\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967238 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967215    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967286 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967262    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967353 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967284    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967353 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967298    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.967451 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967378    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.967663 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:05.967643    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:05.967733 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.967678    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.967733 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:05.967706    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:06.467687541 +0000 UTC m=+40.728998119 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:05.968058 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.968039    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-nginx-conf\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:05.968150 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.968134    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.969242 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.969217    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.969732 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.969713    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.984464 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.984440    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:05.988225 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:05.988194    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fr7n\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:06.091956 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.091926    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c"]
Aug 05 16:22:06.095108 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:06.095073    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45be7fc4_a472_4a10_96ed_336064a45184.slice/crio-d08567e3778de3f4b64669f9475b862bfe2ab367a4eb65a80c7d7968fa43cc31 WatchSource:0}: Error finding container d08567e3778de3f4b64669f9475b862bfe2ab367a4eb65a80c7d7968fa43cc31: Status 404 returned error can't find the container with id d08567e3778de3f4b64669f9475b862bfe2ab367a4eb65a80c7d7968fa43cc31
Aug 05 16:22:06.133288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.133224    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5ccd6b445f-c6b7r"]
Aug 05 16:22:06.137035 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:06.137001    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2d8dcf_0136_4937_8245_f28637046bb2.slice/crio-c8eaa6077d3ba7fb5c7cd1c542baf352803dee0be192c44a95d9fe16ab047432 WatchSource:0}: Error finding container c8eaa6077d3ba7fb5c7cd1c542baf352803dee0be192c44a95d9fe16ab047432: Status 404 returned error can't find the container with id c8eaa6077d3ba7fb5c7cd1c542baf352803dee0be192c44a95d9fe16ab047432
Aug 05 16:22:06.164210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.164192    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-77696685b-2p9n8"]
Aug 05 16:22:06.166107 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:06.166081    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod500f22c1_607f_4cc9_8e24_dad8fcbf5a28.slice/crio-848d02e77e0aad9de2ce16d0218dbef73cbde6007f15c70bcfaab6476d30cca5 WatchSource:0}: Error finding container 848d02e77e0aad9de2ce16d0218dbef73cbde6007f15c70bcfaab6476d30cca5: Status 404 returned error can't find the container with id 848d02e77e0aad9de2ce16d0218dbef73cbde6007f15c70bcfaab6476d30cca5
Aug 05 16:22:06.470789 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.470717    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:06.470789 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.470788    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:06.470962 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:06.470859    2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:06.470962 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:06.470877    2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcc4c47f9-nwqt6: secret "image-registry-tls" not found
Aug 05 16:22:06.470962 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:06.470863    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:06.470962 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:06.470931    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls podName:4450e43b-d942-4ddc-b211-06455dcc8180 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:07.470911006 +0000 UTC m=+41.732221582 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls") pod "image-registry-6fcc4c47f9-nwqt6" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180") : secret "image-registry-tls" not found
Aug 05 16:22:06.470962 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:06.470948    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:07.470935984 +0000 UTC m=+41.732246560 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:06.510451 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.510423    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-2p9n8" event={"ID":"500f22c1-607f-4cc9-8e24-dad8fcbf5a28","Type":"ContainerStarted","Data":"848d02e77e0aad9de2ce16d0218dbef73cbde6007f15c70bcfaab6476d30cca5"}
Aug 05 16:22:06.511458 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.511434    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c" event={"ID":"45be7fc4-a472-4a10-96ed-336064a45184","Type":"ContainerStarted","Data":"d08567e3778de3f4b64669f9475b862bfe2ab367a4eb65a80c7d7968fa43cc31"}
Aug 05 16:22:06.512430 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:06.512408    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" event={"ID":"eb2d8dcf-0136-4937-8245-f28637046bb2","Type":"ContainerStarted","Data":"c8eaa6077d3ba7fb5c7cd1c542baf352803dee0be192c44a95d9fe16ab047432"}
Aug 05 16:22:07.479902 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:07.479863    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:07.480102 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:07.479951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:07.480102 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:07.480061    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:07.480222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:07.480097    2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:07.480222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:07.480118    2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcc4c47f9-nwqt6: secret "image-registry-tls" not found
Aug 05 16:22:07.480222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:07.480142    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:09.48012135 +0000 UTC m=+43.741431936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:07.480222 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:07.480168    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls podName:4450e43b-d942-4ddc-b211-06455dcc8180 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:09.480152148 +0000 UTC m=+43.741462740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls") pod "image-registry-6fcc4c47f9-nwqt6" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180") : secret "image-registry-tls" not found
Aug 05 16:22:08.892402 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:08.892361    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:08.892760 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:08.892520    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:08.892760 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:08.892584    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:16.89256885 +0000 UTC m=+51.153879435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:09.497365 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:09.497308    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:09.497532 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:09.497415    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:09.497532 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:09.497492    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:09.497647 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:09.497537    2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:09.497647 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:09.497552    2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcc4c47f9-nwqt6: secret "image-registry-tls" not found
Aug 05 16:22:09.497647 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:09.497579    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:13.49755542 +0000 UTC m=+47.758866001 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:09.497647 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:09.497604    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls podName:4450e43b-d942-4ddc-b211-06455dcc8180 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:13.497594762 +0000 UTC m=+47.758905343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls") pod "image-registry-6fcc4c47f9-nwqt6" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180") : secret "image-registry-tls" not found
Aug 05 16:22:10.526149 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.526073    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/0.log"
Aug 05 16:22:10.526149 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.526114    2546 generic.go:356] "Generic (PLEG): container finished" podID="eb2d8dcf-0136-4937-8245-f28637046bb2" containerID="6b43c83c84fbb9b247c713a55193de103ba47568cabfc00b48e727eed1d54493" exitCode=255
Aug 05 16:22:10.526644 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.526149    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" event={"ID":"eb2d8dcf-0136-4937-8245-f28637046bb2","Type":"ContainerDied","Data":"6b43c83c84fbb9b247c713a55193de103ba47568cabfc00b48e727eed1d54493"}
Aug 05 16:22:10.526644 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.526406    2546 scope.go:117] "RemoveContainer" containerID="6b43c83c84fbb9b247c713a55193de103ba47568cabfc00b48e727eed1d54493"
Aug 05 16:22:10.527942 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.527918    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-2p9n8" event={"ID":"500f22c1-607f-4cc9-8e24-dad8fcbf5a28","Type":"ContainerStarted","Data":"ed552e025608377a3068e1df2567f0ff38032a272cbf84282bcd3d7e678af766"}
Aug 05 16:22:10.529427 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.529405    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c" event={"ID":"45be7fc4-a472-4a10-96ed-336064a45184","Type":"ContainerStarted","Data":"f41f3a0b33ed1d05a434a4bd218a7cdd7f05b92387276d2b23fcd29de3b65dec"}
Aug 05 16:22:10.557173 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.557135    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c" podStartSLOduration=1.597648171 podStartE2EDuration="5.557118942s" totalImagesPullingTime="3.959470771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:10.555985941 +0000 UTC m=+44.817296540" watchObservedRunningTime="2026-08-05 16:22:10.557118942 +0000 UTC m=+44.818429540"
Aug 05 16:22:10.572061 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:10.572012    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-77696685b-2p9n8" podStartSLOduration=1.67677525 podStartE2EDuration="5.571993592s" totalImagesPullingTime="3.895218342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:10.571188605 +0000 UTC m=+44.832499203" watchObservedRunningTime="2026-08-05 16:22:10.571993592 +0000 UTC m=+44.833304191"
Aug 05 16:22:11.032582 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.032547    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lhj86"]
Aug 05 16:22:11.049876 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.049848    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.055917 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.055892    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Aug 05 16:22:11.056229 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.056209    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rq9ls\""
Aug 05 16:22:11.056376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.056358    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Aug 05 16:22:11.071354 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.071318    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhj86"]
Aug 05 16:22:11.111069 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.111040    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.111196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.111092    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-crio-socket\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.111196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.111120    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.111196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.111154    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glzjn\" (UniqueName: \"kubernetes.io/projected/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-api-access-glzjn\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.111196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.111172    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-data-volume\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.211950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.211919    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-crio-socket\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212087 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.211951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212087 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.211984    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glzjn\" (UniqueName: \"kubernetes.io/projected/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-api-access-glzjn\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212087 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.212049    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-data-volume\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212087 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.212076    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.212291 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.212135    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:11.712120984 +0000 UTC m=+45.973431563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.212291 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.212162    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-crio-socket\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212291 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.212203    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.212291 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.212289    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.212520 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.212365    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:11.712351215 +0000 UTC m=+45.973661792 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.212520 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.212447    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-data-volume\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.220628 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.220602    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glzjn\" (UniqueName: \"kubernetes.io/projected/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-api-access-glzjn\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.533902 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.533875    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:22:11.534357 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.534287    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/0.log"
Aug 05 16:22:11.534357 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.534347    2546 generic.go:356] "Generic (PLEG): container finished" podID="eb2d8dcf-0136-4937-8245-f28637046bb2" containerID="30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9" exitCode=255
Aug 05 16:22:11.534475 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.534432    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" event={"ID":"eb2d8dcf-0136-4937-8245-f28637046bb2","Type":"ContainerDied","Data":"30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9"}
Aug 05 16:22:11.534523 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.534489    2546 scope.go:117] "RemoveContainer" containerID="6b43c83c84fbb9b247c713a55193de103ba47568cabfc00b48e727eed1d54493"
Aug 05 16:22:11.534812 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.534790    2546 scope.go:117] "RemoveContainer" containerID="30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9"
Aug 05 16:22:11.534994 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.534971    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-c6b7r_openshift-console-operator(eb2d8dcf-0136-4937-8245-f28637046bb2)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" podUID="eb2d8dcf-0136-4937-8245-f28637046bb2"
Aug 05 16:22:11.717174 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.717129    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.717407 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:11.717201    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:11.717407 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.717292    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.717407 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.717379    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:11.717407 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.717396    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:12.717374816 +0000 UTC m=+46.978685414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:11.717634 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:11.717431    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:12.717418646 +0000 UTC m=+46.978729222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:12.538382 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:12.538351    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:22:12.538779 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:12.538712    2546 scope.go:117] "RemoveContainer" containerID="30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9"
Aug 05 16:22:12.538931 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:12.538889    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-c6b7r_openshift-console-operator(eb2d8dcf-0136-4937-8245-f28637046bb2)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" podUID="eb2d8dcf-0136-4937-8245-f28637046bb2"
Aug 05 16:22:12.724548 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:12.724514    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:12.724724 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:12.724575    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:12.724724 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:12.724624    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:12.724724 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:12.724679    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:14.724665028 +0000 UTC m=+48.985975607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:12.724724 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:12.724700    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:12.724870 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:12.724738    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:14.724727229 +0000 UTC m=+48.986037804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:12.977375 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:12.977342    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlt9g_0be5ac93-18ef-4053-b0c4-9a0116de7d59/dns-node-resolver/0.log"
Aug 05 16:22:13.531571 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:13.531536    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:13.531731 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:13.531662    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:13.531731 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:13.531691    2546 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Aug 05 16:22:13.531731 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:13.531708    2546 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6fcc4c47f9-nwqt6: secret "image-registry-tls" not found
Aug 05 16:22:13.531832 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:13.531745    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:13.531832 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:13.531771    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls podName:4450e43b-d942-4ddc-b211-06455dcc8180 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:21.531753162 +0000 UTC m=+55.793063752 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls") pod "image-registry-6fcc4c47f9-nwqt6" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180") : secret "image-registry-tls" not found
Aug 05 16:22:13.531832 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:13.531787    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:21.531779822 +0000 UTC m=+55.793090404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:14.175970 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:14.175939    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6k5l_78fb5a58-5e23-4e38-9adc-881a59ef49b1/node-ca/0.log"
Aug 05 16:22:14.575886 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:14.575806    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24c8s_f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea/serve-healthcheck-canary/0.log"
Aug 05 16:22:14.739797 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:14.739761    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:14.739958 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:14.739879    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:14.739958 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:14.739922    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:14.739958 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:14.739954    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:14.740053 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:14.739991    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:18.739972876 +0000 UTC m=+53.001283478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:14.740053 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:14.740006    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:18.740000418 +0000 UTC m=+53.001310994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:15.924358 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:15.924312    2546 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:15.924834 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:15.924387    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:15.924834 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:15.924811    2546 scope.go:117] "RemoveContainer" containerID="30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9"
Aug 05 16:22:15.925023 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:15.924999    2546 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5ccd6b445f-c6b7r_openshift-console-operator(eb2d8dcf-0136-4937-8245-f28637046bb2)\"" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" podUID="eb2d8dcf-0136-4937-8245-f28637046bb2"
Aug 05 16:22:16.956294 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:16.956251    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:16.956764 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:16.956417    2546 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Aug 05 16:22:16.956764 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:16.956476    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls podName:911bcb4c-3fdd-42b4-8372-34fcdd33e8ff nodeName:}" failed. No retries permitted until 2026-08-05 16:22:32.956461928 +0000 UTC m=+67.217772503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls") pod "dns-default-8jgrj" (UID: "911bcb4c-3fdd-42b4-8372-34fcdd33e8ff") : secret "dns-default-metrics-tls" not found
Aug 05 16:22:18.771989 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:18.771956    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:18.772413 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:18.772014    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:18.772413 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:18.772088    2546 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Aug 05 16:22:18.772413 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:18.772109    2546 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:18.772413 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:18.772155    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:26.772138701 +0000 UTC m=+61.033449277 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : configmap "kube-rbac-proxy" not found
Aug 05 16:22:18.772413 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:18.772170    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls podName:f5a8ad5b-f1e8-435d-ab33-cabe36c71151 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:26.772163992 +0000 UTC m=+61.033474567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lhj86" (UID: "f5a8ad5b-f1e8-435d-ab33-cabe36c71151") : secret "insights-runtime-extractor-tls" not found
Aug 05 16:22:21.595294 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:21.595260    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:21.595788 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:21.595318    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:21.595788 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:21.595428    2546 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Aug 05 16:22:21.595788 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:21.595503    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert podName:c357fccf-9a2f-47eb-846c-f5bcee45bcc3 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:37.595483886 +0000 UTC m=+71.856794468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert") pod "networking-console-plugin-f77f48c6d-s7lpt" (UID: "c357fccf-9a2f-47eb-846c-f5bcee45bcc3") : secret "networking-console-plugin-cert" not found
Aug 05 16:22:21.597838 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:21.597820    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"image-registry-6fcc4c47f9-nwqt6\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") " pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:21.639360 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:21.639332    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:21.764386 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:21.764344    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:22:21.767129 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:21.767099    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4450e43b_d942_4ddc_b211_06455dcc8180.slice/crio-b45a5734e09c123ef522b01dfcfa30e3eca217be4138629759f3b07e98dbfaf7 WatchSource:0}: Error finding container b45a5734e09c123ef522b01dfcfa30e3eca217be4138629759f3b07e98dbfaf7: Status 404 returned error can't find the container with id b45a5734e09c123ef522b01dfcfa30e3eca217be4138629759f3b07e98dbfaf7
Aug 05 16:22:22.568040 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:22.568003    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" event={"ID":"4450e43b-d942-4ddc-b211-06455dcc8180","Type":"ContainerStarted","Data":"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"}
Aug 05 16:22:22.568251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:22.568087    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" event={"ID":"4450e43b-d942-4ddc-b211-06455dcc8180","Type":"ContainerStarted","Data":"b45a5734e09c123ef522b01dfcfa30e3eca217be4138629759f3b07e98dbfaf7"}
Aug 05 16:22:22.568251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:22.568135    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:22.590395 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:22.590342    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" podStartSLOduration=17.590311331 podStartE2EDuration="17.590311331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:22.589772842 +0000 UTC m=+56.851083441" watchObservedRunningTime="2026-08-05 16:22:22.590311331 +0000 UTC m=+56.851621929"
Aug 05 16:22:26.477217 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.477184    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8qkdk"
Aug 05 16:22:26.836346 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.836286    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:26.836527 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.836403    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:26.836803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.836783    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:26.838575 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.838558    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f5a8ad5b-f1e8-435d-ab33-cabe36c71151-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lhj86\" (UID: \"f5a8ad5b-f1e8-435d-ab33-cabe36c71151\") " pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:26.962171 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.962137    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rq9ls\""
Aug 05 16:22:26.969863 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:26.969845    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lhj86"
Aug 05 16:22:27.120157 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:27.120080    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lhj86"]
Aug 05 16:22:27.123401 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:27.123376    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5a8ad5b_f1e8_435d_ab33_cabe36c71151.slice/crio-064c7c050b1a11c68b2014145131fbf7bfd3c279ca8afd28083026eb79f70fed WatchSource:0}: Error finding container 064c7c050b1a11c68b2014145131fbf7bfd3c279ca8afd28083026eb79f70fed: Status 404 returned error can't find the container with id 064c7c050b1a11c68b2014145131fbf7bfd3c279ca8afd28083026eb79f70fed
Aug 05 16:22:27.581829 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:27.581758    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhj86" event={"ID":"f5a8ad5b-f1e8-435d-ab33-cabe36c71151","Type":"ContainerStarted","Data":"58fc81a36b4a212f6c2c4ad7212c54ef4d36c53b8d1db6b1f3a6944c1f4487c1"}
Aug 05 16:22:27.581829 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:27.581812    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhj86" event={"ID":"f5a8ad5b-f1e8-435d-ab33-cabe36c71151","Type":"ContainerStarted","Data":"064c7c050b1a11c68b2014145131fbf7bfd3c279ca8afd28083026eb79f70fed"}
Aug 05 16:22:28.304546 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.304513    2546 scope.go:117] "RemoveContainer" containerID="30521ac0cbe2b2710948572b56e2b80edf1539475d8a39037d3bf147976a13c9"
Aug 05 16:22:28.586545 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.586516    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:22:28.586986 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.586619    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" event={"ID":"eb2d8dcf-0136-4937-8245-f28637046bb2","Type":"ContainerStarted","Data":"7698eceff70143dd10107c7c7a4b08bb175814c01f3658ca545ee4055d91f84b"}
Aug 05 16:22:28.586986 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.586967    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:28.588565 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.588537    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhj86" event={"ID":"f5a8ad5b-f1e8-435d-ab33-cabe36c71151","Type":"ContainerStarted","Data":"61c297ab32d7b191dda7d66754935206d5305633097020aa21a9880b2d2a7d2e"}
Aug 05 16:22:28.608851 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.608671    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r" podStartSLOduration=19.690879872 podStartE2EDuration="23.608658486s" totalImagesPullingTime="3.917778614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:28.608535678 +0000 UTC m=+62.869846275" watchObservedRunningTime="2026-08-05 16:22:28.608658486 +0000 UTC m=+62.869969084"
Aug 05 16:22:28.866653 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:28.866570    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5ccd6b445f-c6b7r"
Aug 05 16:22:30.596492 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:30.596454    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lhj86" event={"ID":"f5a8ad5b-f1e8-435d-ab33-cabe36c71151","Type":"ContainerStarted","Data":"0a3efefedbd189cb997e27d17e6a681ef158281ea8092cf55948419238baa01e"}
Aug 05 16:22:30.615524 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:30.615476    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lhj86" podStartSLOduration=18.189273887 podStartE2EDuration="20.615461411s" totalImagesPullingTime="2.426187524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:30.615154719 +0000 UTC m=+64.876465317" watchObservedRunningTime="2026-08-05 16:22:30.615461411 +0000 UTC m=+64.876772002"
Aug 05 16:22:30.968119 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:30.968029    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:22:30.970824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:30.970805    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Aug 05 16:22:30.980902 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:30.980877    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/08792d7f-edb3-4507-96d9-f6cfd3288774-original-pull-secret\") pod \"global-pull-secret-syncer-6kjcp\" (UID: \"08792d7f-edb3-4507-96d9-f6cfd3288774\") " pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:22:31.025108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.025079    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6kjcp"
Aug 05 16:22:31.069566 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.069528    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:22:31.072554 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.072524    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Aug 05 16:22:31.083439 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.083412    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4ed2e991-89b1-40cb-ab9a-1c31a03959e5-metrics-certs\") pod \"network-metrics-daemon-rh8d9\" (UID: \"4ed2e991-89b1-40cb-ab9a-1c31a03959e5\") " pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:22:31.150461 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.150433    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6kjcp"]
Aug 05 16:22:31.153276 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:31.153245    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08792d7f_edb3_4507_96d9_f6cfd3288774.slice/crio-64302ba6b294d0c011fba9990a0749f5937698205d5d4615d836a38d13d16c95 WatchSource:0}: Error finding container 64302ba6b294d0c011fba9990a0749f5937698205d5d4615d836a38d13d16c95: Status 404 returned error can't find the container with id 64302ba6b294d0c011fba9990a0749f5937698205d5d4615d836a38d13d16c95
Aug 05 16:22:31.170070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.170043    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:22:31.172544 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.172529    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Aug 05 16:22:31.183372 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.183358    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Aug 05 16:22:31.193965 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.193944    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sw95t\" (UniqueName: \"kubernetes.io/projected/7226519c-52ae-4657-b24d-8d859930e4d2-kube-api-access-sw95t\") pod \"network-check-target-lkcd8\" (UID: \"7226519c-52ae-4657-b24d-8d859930e4d2\") " pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:22:31.317910 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.317834    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-64w4b\""
Aug 05 16:22:31.326574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.326556    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:22:31.334277 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.334252    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-w287q\""
Aug 05 16:22:31.342971 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.342950    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rh8d9"
Aug 05 16:22:31.453347 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.453292    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lkcd8"]
Aug 05 16:22:31.456649 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:31.456625    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7226519c_52ae_4657_b24d_8d859930e4d2.slice/crio-9a1b0d1eae99ccd75195ff772c21e25f6c8db6d6c7873aae5c01f03fbfcdaca5 WatchSource:0}: Error finding container 9a1b0d1eae99ccd75195ff772c21e25f6c8db6d6c7873aae5c01f03fbfcdaca5: Status 404 returned error can't find the container with id 9a1b0d1eae99ccd75195ff772c21e25f6c8db6d6c7873aae5c01f03fbfcdaca5
Aug 05 16:22:31.473300 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.473278    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rh8d9"]
Aug 05 16:22:31.476443 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:31.476421    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ed2e991_89b1_40cb_ab9a_1c31a03959e5.slice/crio-e8f2444abbb423ada12320a41bfac68f40ec599da3514e401340c29cd16d7f8d WatchSource:0}: Error finding container e8f2444abbb423ada12320a41bfac68f40ec599da3514e401340c29cd16d7f8d: Status 404 returned error can't find the container with id e8f2444abbb423ada12320a41bfac68f40ec599da3514e401340c29cd16d7f8d
Aug 05 16:22:31.601216 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.601176    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh8d9" event={"ID":"4ed2e991-89b1-40cb-ab9a-1c31a03959e5","Type":"ContainerStarted","Data":"e8f2444abbb423ada12320a41bfac68f40ec599da3514e401340c29cd16d7f8d"}
Aug 05 16:22:31.602500 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.602472    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lkcd8" event={"ID":"7226519c-52ae-4657-b24d-8d859930e4d2","Type":"ContainerStarted","Data":"9a1b0d1eae99ccd75195ff772c21e25f6c8db6d6c7873aae5c01f03fbfcdaca5"}
Aug 05 16:22:31.603649 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:31.603619    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6kjcp" event={"ID":"08792d7f-edb3-4507-96d9-f6cfd3288774","Type":"ContainerStarted","Data":"64302ba6b294d0c011fba9990a0749f5937698205d5d4615d836a38d13d16c95"}
Aug 05 16:22:32.988153 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:32.988117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:32.991574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:32.991548    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/911bcb4c-3fdd-42b4-8372-34fcdd33e8ff-metrics-tls\") pod \"dns-default-8jgrj\" (UID: \"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff\") " pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:33.224208 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.224171    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-cnw72\""
Aug 05 16:22:33.233043 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.233005    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:33.394497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.394405    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8jgrj"]
Aug 05 16:22:33.400222 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:33.398989    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911bcb4c_3fdd_42b4_8372_34fcdd33e8ff.slice/crio-0d7fb8d18c34e3a86f4f6b08e91e30dab9c3430fd3af65090e61a6a60d9cdb72 WatchSource:0}: Error finding container 0d7fb8d18c34e3a86f4f6b08e91e30dab9c3430fd3af65090e61a6a60d9cdb72: Status 404 returned error can't find the container with id 0d7fb8d18c34e3a86f4f6b08e91e30dab9c3430fd3af65090e61a6a60d9cdb72
Aug 05 16:22:33.617824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.617782    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jgrj" event={"ID":"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff","Type":"ContainerStarted","Data":"0d7fb8d18c34e3a86f4f6b08e91e30dab9c3430fd3af65090e61a6a60d9cdb72"}
Aug 05 16:22:33.619843 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.619810    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh8d9" event={"ID":"4ed2e991-89b1-40cb-ab9a-1c31a03959e5","Type":"ContainerStarted","Data":"49cb57bcc39fd211b2bf932bc49d3e6b60518896e6d23572ceb23362ba7a359c"}
Aug 05 16:22:33.619976 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.619865    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rh8d9" event={"ID":"4ed2e991-89b1-40cb-ab9a-1c31a03959e5","Type":"ContainerStarted","Data":"3ddbf3ed371f5ef3d30c9a9ef3ef2ead90c691f5ec6d9ce3eac69d06002238c2"}
Aug 05 16:22:33.638915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:33.638871    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rh8d9" podStartSLOduration=65.552858311 podStartE2EDuration="1m6.638856376s" totalImagesPullingTime="1.085998065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:33.638243805 +0000 UTC m=+67.899554406" watchObservedRunningTime="2026-08-05 16:22:33.638856376 +0000 UTC m=+67.900167004"
Aug 05 16:22:34.886921 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.886886    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"]
Aug 05 16:22:34.908073 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.908046    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:34.918449 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.918372    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"]
Aug 05 16:22:34.920743 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.920714    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Aug 05 16:22:34.920873 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.920857    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Aug 05 16:22:34.920940 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.920923    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Aug 05 16:22:34.921224 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.921205    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Aug 05 16:22:34.987083 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:34.987049    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"]
Aug 05 16:22:35.004194 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.004162    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.004415 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.004227    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5dqd\" (UniqueName: \"kubernetes.io/projected/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-kube-api-access-g5dqd\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.004415 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.004358    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-tmp\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.008251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.008222    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:22:35.008399 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.008273    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"]
Aug 05 16:22:35.008453 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.008378    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:35.011561 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.011538    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9t92r\""
Aug 05 16:22:35.011756 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.011737    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Aug 05 16:22:35.065796 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.065760    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"]
Aug 05 16:22:35.071639 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.071610    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.086065 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.086035    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"]
Aug 05 16:22:35.104899 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.104848    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.105065 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.104923    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5dqd\" (UniqueName: \"kubernetes.io/projected/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-kube-api-access-g5dqd\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.105065 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.104977    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b2935d-3317-4e59-ab12-4528e8c322a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-df6ts\" (UID: \"51b2935d-3317-4e59-ab12-4528e8c322a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:35.105065 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.105049    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-tmp\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.105541 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.105516    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-tmp\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.107789 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.107761    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-klusterlet-config\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.114989 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.114961    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5dqd\" (UniqueName: \"kubernetes.io/projected/5ac2f3b6-1785-4e9c-a1a1-557799c5c18a-kube-api-access-g5dqd\") pod \"klusterlet-addon-workmgr-8b689f8-hwdb8\" (UID: \"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.205568 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205496    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-tls\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205568 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205552    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-trusted-ca\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205759 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205630    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c13b6e6a-7780-4971-b664-5a242db7fd59-ca-trust-extracted\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205759 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205653    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-certificates\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205759 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205688    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-bound-sa-token\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205783    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b2935d-3317-4e59-ab12-4528e8c322a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-df6ts\" (UID: \"51b2935d-3317-4e59-ab12-4528e8c322a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:35.205915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205830    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-image-registry-private-configuration\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205861    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-installation-pull-secrets\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.205915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.205911    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6tmm\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-kube-api-access-v6tmm\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.208289 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.208267    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/51b2935d-3317-4e59-ab12-4528e8c322a4-tls-certificates\") pod \"prometheus-operator-admission-webhook-66685ff6d4-df6ts\" (UID: \"51b2935d-3317-4e59-ab12-4528e8c322a4\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:35.221057 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.221032    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:35.306512 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306469    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c13b6e6a-7780-4971-b664-5a242db7fd59-ca-trust-extracted\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306519    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-certificates\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306546    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-bound-sa-token\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306592    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-image-registry-private-configuration\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306633    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-installation-pull-secrets\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306886 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306677    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6tmm\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-kube-api-access-v6tmm\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306886 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306711    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-tls\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.306886 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306749    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-trusted-ca\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.307035 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.306939    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c13b6e6a-7780-4971-b664-5a242db7fd59-ca-trust-extracted\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.307484 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.307427    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-certificates\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.307806 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.307784    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c13b6e6a-7780-4971-b664-5a242db7fd59-trusted-ca\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.309431 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.309406    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-installation-pull-secrets\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.309534 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.309428    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c13b6e6a-7780-4971-b664-5a242db7fd59-image-registry-private-configuration\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.309534 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.309417    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-registry-tls\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.316873 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.316848    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-bound-sa-token\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.317432 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.317401    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6tmm\" (UniqueName: \"kubernetes.io/projected/c13b6e6a-7780-4971-b664-5a242db7fd59-kube-api-access-v6tmm\") pod \"image-registry-6f78d4bd5c-v6kcn\" (UID: \"c13b6e6a-7780-4971-b664-5a242db7fd59\") " pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:35.320050 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.320031    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:35.382906 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:35.382871    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:36.445363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.445314    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"]
Aug 05 16:22:36.634268 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.634228    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lkcd8" event={"ID":"7226519c-52ae-4657-b24d-8d859930e4d2","Type":"ContainerStarted","Data":"b14f33139008e9ecf98a61502087841fb11f06c3af06277ebbdee432718ba107"}
Aug 05 16:22:36.634478 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.634343    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:22:36.635945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.635914    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6kjcp" event={"ID":"08792d7f-edb3-4507-96d9-f6cfd3288774","Type":"ContainerStarted","Data":"b8df2f9e181a1f1740247c98a219ac395a9660371d931d3671932965815b5799"}
Aug 05 16:22:36.652906 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.652633    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lkcd8" podStartSLOduration=64.829564837 podStartE2EDuration="1m9.652613916s" totalImagesPullingTime="4.823049079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:36.652530121 +0000 UTC m=+70.913840718" watchObservedRunningTime="2026-08-05 16:22:36.652613916 +0000 UTC m=+70.913924516"
Aug 05 16:22:36.669943 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.669915    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"]
Aug 05 16:22:36.673572 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.673549    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"]
Aug 05 16:22:36.673903 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:36.673859    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6kjcp" podStartSLOduration=64.55728797 podStartE2EDuration="1m9.673845894s" totalImagesPullingTime="5.116557924s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 16:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:36.671836358 +0000 UTC m=+70.933146957" watchObservedRunningTime="2026-08-05 16:22:36.673845894 +0000 UTC m=+70.935156490"
Aug 05 16:22:36.900269 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:36.900201    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac2f3b6_1785_4e9c_a1a1_557799c5c18a.slice/crio-eb5b455d041bfff679aad802033af8b5b316844803bb0921cc419479e9f8d901 WatchSource:0}: Error finding container eb5b455d041bfff679aad802033af8b5b316844803bb0921cc419479e9f8d901: Status 404 returned error can't find the container with id eb5b455d041bfff679aad802033af8b5b316844803bb0921cc419479e9f8d901
Aug 05 16:22:36.900938 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:36.900820    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b2935d_3317_4e59_ab12_4528e8c322a4.slice/crio-073ab88bc236e39bad120e39f21e6a18d1372b900f4bd198739ce72c5ab26596 WatchSource:0}: Error finding container 073ab88bc236e39bad120e39f21e6a18d1372b900f4bd198739ce72c5ab26596: Status 404 returned error can't find the container with id 073ab88bc236e39bad120e39f21e6a18d1372b900f4bd198739ce72c5ab26596
Aug 05 16:22:36.901644 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:36.901621    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13b6e6a_7780_4971_b664_5a242db7fd59.slice/crio-78c94cbf36b075494c4c48e7c9f0f80c608d99d4e5c1dbee5953d483b3100ef0 WatchSource:0}: Error finding container 78c94cbf36b075494c4c48e7c9f0f80c608d99d4e5c1dbee5953d483b3100ef0: Status 404 returned error can't find the container with id 78c94cbf36b075494c4c48e7c9f0f80c608d99d4e5c1dbee5953d483b3100ef0
Aug 05 16:22:37.626612 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.626572    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:37.629145 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.629121    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c357fccf-9a2f-47eb-846c-f5bcee45bcc3-networking-console-plugin-cert\") pod \"networking-console-plugin-f77f48c6d-s7lpt\" (UID: \"c357fccf-9a2f-47eb-846c-f5bcee45bcc3\") " pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:37.650853 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.650816    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn" event={"ID":"c13b6e6a-7780-4971-b664-5a242db7fd59","Type":"ContainerStarted","Data":"858d7389d454447b51404fa62de0990ba12a3944f6d8468f3154212d77773fc8"}
Aug 05 16:22:37.651005 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.650907    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn" event={"ID":"c13b6e6a-7780-4971-b664-5a242db7fd59","Type":"ContainerStarted","Data":"78c94cbf36b075494c4c48e7c9f0f80c608d99d4e5c1dbee5953d483b3100ef0"}
Aug 05 16:22:37.651005 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.650936    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:37.653636 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.653438    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jgrj" event={"ID":"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff","Type":"ContainerStarted","Data":"a7ebc3638bf92a03a11fbd047d055cc309b24284110fb7b7b74ebe80264f82cb"}
Aug 05 16:22:37.653636 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.653494    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8jgrj" event={"ID":"911bcb4c-3fdd-42b4-8372-34fcdd33e8ff","Type":"ContainerStarted","Data":"2c495c07f9b55b4b969387be80f2af6508c67e71d001872cf337fafc1ea0ad07"}
Aug 05 16:22:37.653636 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.653523    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:37.654939 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.654913    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts" event={"ID":"51b2935d-3317-4e59-ab12-4528e8c322a4","Type":"ContainerStarted","Data":"073ab88bc236e39bad120e39f21e6a18d1372b900f4bd198739ce72c5ab26596"}
Aug 05 16:22:37.656093 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.656072    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8" event={"ID":"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a","Type":"ContainerStarted","Data":"eb5b455d041bfff679aad802033af8b5b316844803bb0921cc419479e9f8d901"}
Aug 05 16:22:37.676047 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.676001    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn" podStartSLOduration=2.675983704 podStartE2EDuration="2.675983704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:37.674285279 +0000 UTC m=+71.935595877" watchObservedRunningTime="2026-08-05 16:22:37.675983704 +0000 UTC m=+71.937294296"
Aug 05 16:22:37.696866 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.696827    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8jgrj" podStartSLOduration=33.167623374 podStartE2EDuration="36.696809484s" totalImagesPullingTime="3.52918611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:37.696117622 +0000 UTC m=+71.957428244" watchObservedRunningTime="2026-08-05 16:22:37.696809484 +0000 UTC m=+71.958120084"
Aug 05 16:22:37.822238 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.822204    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-54kcz\""
Aug 05 16:22:37.829593 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.829562    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"
Aug 05 16:22:37.967597 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:37.967562    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt"]
Aug 05 16:22:38.096623 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:38.096582    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc357fccf_9a2f_47eb_846c_f5bcee45bcc3.slice/crio-5552880bbde58b86cf4ad69e4e00547125f55c060e2c24efc901aaaae8be5563 WatchSource:0}: Error finding container 5552880bbde58b86cf4ad69e4e00547125f55c060e2c24efc901aaaae8be5563: Status 404 returned error can't find the container with id 5552880bbde58b86cf4ad69e4e00547125f55c060e2c24efc901aaaae8be5563
Aug 05 16:22:38.662981 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:38.662944    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts" event={"ID":"51b2935d-3317-4e59-ab12-4528e8c322a4","Type":"ContainerStarted","Data":"209ea268672cad90ddcb1701a8d141bbfcd88afc0d0476d7a830af6473139cf5"}
Aug 05 16:22:38.663453 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:38.663134    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:38.664508 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:38.664482    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt" event={"ID":"c357fccf-9a2f-47eb-846c-f5bcee45bcc3","Type":"ContainerStarted","Data":"5552880bbde58b86cf4ad69e4e00547125f55c060e2c24efc901aaaae8be5563"}
Aug 05 16:22:38.668817 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:38.668798    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts"
Aug 05 16:22:38.682882 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:38.682837    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-66685ff6d4-df6ts" podStartSLOduration=3.447333243 podStartE2EDuration="4.682817897s" totalImagesPullingTime="1.235484654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:38.682147414 +0000 UTC m=+72.943458009" watchObservedRunningTime="2026-08-05 16:22:38.682817897 +0000 UTC m=+72.944128482"
Aug 05 16:22:39.461115 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.461077    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"]
Aug 05 16:22:39.466010 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.465988    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.469058 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469032    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Aug 05 16:22:39.469185 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469096    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Aug 05 16:22:39.469185 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469032    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Aug 05 16:22:39.469379 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469351    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-nxj74\""
Aug 05 16:22:39.469477 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469396    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Aug 05 16:22:39.469477 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.469456    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Aug 05 16:22:39.480097 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.480030    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"]
Aug 05 16:22:39.545907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.545870    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfxpn\" (UniqueName: \"kubernetes.io/projected/e1967d6d-d697-4ea4-bcf2-78b334e84b43-kube-api-access-lfxpn\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.545907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.545916    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.546162 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.545943    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1967d6d-d697-4ea4-bcf2-78b334e84b43-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.546162 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.546041    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.647372 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.647318    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfxpn\" (UniqueName: \"kubernetes.io/projected/e1967d6d-d697-4ea4-bcf2-78b334e84b43-kube-api-access-lfxpn\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.647551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.647386    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.647551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.647422    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1967d6d-d697-4ea4-bcf2-78b334e84b43-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.647551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.647484    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.647719 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:39.647575    2546 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Aug 05 16:22:39.647719 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:39.647652    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls podName:e1967d6d-d697-4ea4-bcf2-78b334e84b43 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:40.147631063 +0000 UTC m=+74.408941651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls") pod "prometheus-operator-758d7cb874-8h7fl" (UID: "e1967d6d-d697-4ea4-bcf2-78b334e84b43") : secret "prometheus-operator-tls" not found
Aug 05 16:22:39.648165 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.648144    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1967d6d-d697-4ea4-bcf2-78b334e84b43-metrics-client-ca\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.650066 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.650027    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:39.660767 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:39.660741    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfxpn\" (UniqueName: \"kubernetes.io/projected/e1967d6d-d697-4ea4-bcf2-78b334e84b43-kube-api-access-lfxpn\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:40.151206 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.151164    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:40.153899 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.153871    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e1967d6d-d697-4ea4-bcf2-78b334e84b43-prometheus-operator-tls\") pod \"prometheus-operator-758d7cb874-8h7fl\" (UID: \"e1967d6d-d697-4ea4-bcf2-78b334e84b43\") " pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:40.376117 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.376082    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"
Aug 05 16:22:40.521471 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.521434    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-758d7cb874-8h7fl"]
Aug 05 16:22:40.525140 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:40.525112    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1967d6d_d697_4ea4_bcf2_78b334e84b43.slice/crio-0969d3702d35afc7286c514c939f57a68385b4e21463511805c48074ce059fcc WatchSource:0}: Error finding container 0969d3702d35afc7286c514c939f57a68385b4e21463511805c48074ce059fcc: Status 404 returned error can't find the container with id 0969d3702d35afc7286c514c939f57a68385b4e21463511805c48074ce059fcc
Aug 05 16:22:40.674535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.674497    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl" event={"ID":"e1967d6d-d697-4ea4-bcf2-78b334e84b43","Type":"ContainerStarted","Data":"0969d3702d35afc7286c514c939f57a68385b4e21463511805c48074ce059fcc"}
Aug 05 16:22:40.676194 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.676160    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt" event={"ID":"c357fccf-9a2f-47eb-846c-f5bcee45bcc3","Type":"ContainerStarted","Data":"ef9e661777cf3e8d1dfec362bf9d44a582b8456e37f7067198b837b393d6309c"}
Aug 05 16:22:40.696615 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:40.696540    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-f77f48c6d-s7lpt" podStartSLOduration=33.588167722 podStartE2EDuration="35.696526935s" totalImagesPullingTime="2.108359213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:40.69423798 +0000 UTC m=+74.955548591" watchObservedRunningTime="2026-08-05 16:22:40.696526935 +0000 UTC m=+74.957837532"
Aug 05 16:22:42.686741 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:42.686703    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl" event={"ID":"e1967d6d-d697-4ea4-bcf2-78b334e84b43","Type":"ContainerStarted","Data":"f251ea8307382e05991674e69eafdfa66fe31b7ee935d28273c399b521aa195f"}
Aug 05 16:22:42.687195 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:42.686767    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl" event={"ID":"e1967d6d-d697-4ea4-bcf2-78b334e84b43","Type":"ContainerStarted","Data":"7499eec03e4e035cd549740b3077e6bee900fd017ec28b6ffa75233c7c1b5841"}
Aug 05 16:22:42.706783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:42.706735    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-758d7cb874-8h7fl" podStartSLOduration=2.016416733 podStartE2EDuration="3.706718775s" totalImagesPullingTime="1.690302042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:42.705293928 +0000 UTC m=+76.966604538" watchObservedRunningTime="2026-08-05 16:22:42.706718775 +0000 UTC m=+76.968029373"
Aug 05 16:22:44.695232 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.695191    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8" event={"ID":"5ac2f3b6-1785-4e9c-a1a1-557799c5c18a","Type":"ContainerStarted","Data":"38d7174d518ce0808cac079fe250ebe0c8445c13db1cd22648cd55f15e55a740"}
Aug 05 16:22:44.695712 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.695446    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:44.697192 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.697174    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8"
Aug 05 16:22:44.713022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.712969    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-8b689f8-hwdb8" podStartSLOduration=3.421424901 podStartE2EDuration="10.712951083s" totalImagesPullingTime="7.291526182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:44.711491507 +0000 UTC m=+78.972802128" watchObservedRunningTime="2026-08-05 16:22:44.712951083 +0000 UTC m=+78.974261682"
Aug 05 16:22:44.903241 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.903210    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"]
Aug 05 16:22:44.905557 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.905532    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:44.907934 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.907912    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Aug 05 16:22:44.908277 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.908256    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Aug 05 16:22:44.908382 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.908367    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-54g9j\""
Aug 05 16:22:44.919541 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.919520    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wfbvt"]
Aug 05 16:22:44.921528 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.921512    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.924718 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.924695    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Aug 05 16:22:44.924899 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.924725    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Aug 05 16:22:44.926205 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.926171    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"]
Aug 05 16:22:44.928281 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.928260    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Aug 05 16:22:44.928610 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.928590    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-zxk8h\""
Aug 05 16:22:44.995907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.995827    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-wtmp\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.995907 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.995867    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.995920    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-sys\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.995946    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-metrics-client-ca\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.995978    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr9jz\" (UniqueName: \"kubernetes.io/projected/b73a436f-ac07-445c-94a6-f4f0e0d1143f-kube-api-access-wr9jz\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996011    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-tls\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996033    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996048    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-root\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996071 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996066    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:44.996304 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996093    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-textfile\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:44.996304 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996159    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btq9v\" (UniqueName: \"kubernetes.io/projected/62f99e9a-a36f-4fca-9cea-64a532717b35-kube-api-access-btq9v\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:44.996304 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996183    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f99e9a-a36f-4fca-9cea-64a532717b35-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:44.996304 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:44.996208    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.013230 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.013204    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:22:45.097610 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097578    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr9jz\" (UniqueName: \"kubernetes.io/projected/b73a436f-ac07-445c-94a6-f4f0e0d1143f-kube-api-access-wr9jz\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.097791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097626    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-tls\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.097791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097660    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.097791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097685    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-root\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.097791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097748    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097812    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-root\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097847    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-textfile\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097887    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btq9v\" (UniqueName: \"kubernetes.io/projected/62f99e9a-a36f-4fca-9cea-64a532717b35-kube-api-access-btq9v\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097919    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f99e9a-a36f-4fca-9cea-64a532717b35-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:45.097828    2546 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Aug 05 16:22:45.097964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097944    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.097990    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-wtmp\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:22:45.098033    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls podName:62f99e9a-a36f-4fca-9cea-64a532717b35 nodeName:}" failed. No retries permitted until 2026-08-05 16:22:45.597997823 +0000 UTC m=+79.859308402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls") pod "openshift-state-metrics-6bb4d7b4dd-nm8mh" (UID: "62f99e9a-a36f-4fca-9cea-64a532717b35") : secret "openshift-state-metrics-tls" not found
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098092    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098124    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-wtmp\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098135    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-sys\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098190    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-textfile\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098195    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b73a436f-ac07-445c-94a6-f4f0e0d1143f-sys\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098359    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-metrics-client-ca\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098792 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098763    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.098962 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098895    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b73a436f-ac07-445c-94a6-f4f0e0d1143f-metrics-client-ca\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.099076 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.098905    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62f99e9a-a36f-4fca-9cea-64a532717b35-metrics-client-ca\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.100443 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.100412    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.100515 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.100444    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.100564 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.100547    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b73a436f-ac07-445c-94a6-f4f0e0d1143f-node-exporter-tls\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.114579 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.114555    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr9jz\" (UniqueName: \"kubernetes.io/projected/b73a436f-ac07-445c-94a6-f4f0e0d1143f-kube-api-access-wr9jz\") pod \"node-exporter-wfbvt\" (UID: \"b73a436f-ac07-445c-94a6-f4f0e0d1143f\") " pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.114723 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.114603    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btq9v\" (UniqueName: \"kubernetes.io/projected/62f99e9a-a36f-4fca-9cea-64a532717b35-kube-api-access-btq9v\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.230634 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.230602    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wfbvt"
Aug 05 16:22:45.242281 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:45.242254    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73a436f_ac07_445c_94a6_f4f0e0d1143f.slice/crio-f3512ad1c86465e8c8ddc73032fd5e717884b587a16bfd1e1ef9a185f1294d1b WatchSource:0}: Error finding container f3512ad1c86465e8c8ddc73032fd5e717884b587a16bfd1e1ef9a185f1294d1b: Status 404 returned error can't find the container with id f3512ad1c86465e8c8ddc73032fd5e717884b587a16bfd1e1ef9a185f1294d1b
Aug 05 16:22:45.602660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.602629    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.605010 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.604986    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/62f99e9a-a36f-4fca-9cea-64a532717b35-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6bb4d7b4dd-nm8mh\" (UID: \"62f99e9a-a36f-4fca-9cea-64a532717b35\") " pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.699712 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.699677    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wfbvt" event={"ID":"b73a436f-ac07-445c-94a6-f4f0e0d1143f","Type":"ContainerStarted","Data":"f3512ad1c86465e8c8ddc73032fd5e717884b587a16bfd1e1ef9a185f1294d1b"}
Aug 05 16:22:45.814744 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.814710    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"
Aug 05 16:22:45.953823 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:45.953793    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh"]
Aug 05 16:22:45.957147 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:45.957119    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62f99e9a_a36f_4fca_9cea_64a532717b35.slice/crio-517645daa8e3d2322019b74ddbe1810d35325ede27c7c0b29ff0924e52421f11 WatchSource:0}: Error finding container 517645daa8e3d2322019b74ddbe1810d35325ede27c7c0b29ff0924e52421f11: Status 404 returned error can't find the container with id 517645daa8e3d2322019b74ddbe1810d35325ede27c7c0b29ff0924e52421f11
Aug 05 16:22:46.705008 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:46.704971    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh" event={"ID":"62f99e9a-a36f-4fca-9cea-64a532717b35","Type":"ContainerStarted","Data":"614160a1f769ddb2582bc6998cf841be7b720a782f7e1cc5d6320ee728d2d607"}
Aug 05 16:22:46.705409 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:46.705032    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh" event={"ID":"62f99e9a-a36f-4fca-9cea-64a532717b35","Type":"ContainerStarted","Data":"493486f32d3571681f4c1944070ed59c535cf00ba05a743a0cc4de129196b359"}
Aug 05 16:22:46.705409 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:46.705080    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh" event={"ID":"62f99e9a-a36f-4fca-9cea-64a532717b35","Type":"ContainerStarted","Data":"517645daa8e3d2322019b74ddbe1810d35325ede27c7c0b29ff0924e52421f11"}
Aug 05 16:22:47.667604 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:47.667569    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8jgrj"
Aug 05 16:22:47.711504 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:47.711466    2546 generic.go:356] "Generic (PLEG): container finished" podID="b73a436f-ac07-445c-94a6-f4f0e0d1143f" containerID="4e475f2651fdf56c187a0ba081e39b2c5b64bd53d4f5db5a6ea9bcce7e9521b7" exitCode=0
Aug 05 16:22:47.711912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:47.711537    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wfbvt" event={"ID":"b73a436f-ac07-445c-94a6-f4f0e0d1143f","Type":"ContainerDied","Data":"4e475f2651fdf56c187a0ba081e39b2c5b64bd53d4f5db5a6ea9bcce7e9521b7"}
Aug 05 16:22:48.136342 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.136297    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"]
Aug 05 16:22:48.139709 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.139695    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.142677 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.142657    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Aug 05 16:22:48.142831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.142668    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Aug 05 16:22:48.142831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.142788    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-xkhxf\""
Aug 05 16:22:48.143518 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.143499    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-869c7n9l42qh4\""
Aug 05 16:22:48.143701 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.143687    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Aug 05 16:22:48.143780 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.143762    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Aug 05 16:22:48.143850 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.143837    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Aug 05 16:22:48.168455 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.168422    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"]
Aug 05 16:22:48.226005 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.225970    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226204 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226023    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226204 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226051    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226204 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226122    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226204 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226142    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226452 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226233    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97225a65-c434-4f21-8a61-80e50eb79cc9-metrics-client-ca\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226452 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226269    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2r45\" (UniqueName: \"kubernetes.io/projected/97225a65-c434-4f21-8a61-80e50eb79cc9-kube-api-access-z2r45\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.226452 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.226300    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-grpc-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.326965 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.326931    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-grpc-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.326965 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.326972    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327009    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327033    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327057    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327074    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327110    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97225a65-c434-4f21-8a61-80e50eb79cc9-metrics-client-ca\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327144    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2r45\" (UniqueName: \"kubernetes.io/projected/97225a65-c434-4f21-8a61-80e50eb79cc9-kube-api-access-z2r45\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.327999 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.327930    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/97225a65-c434-4f21-8a61-80e50eb79cc9-metrics-client-ca\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.329821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.329772    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.330288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.330046    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.330288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.330212    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.330288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.330271    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-grpc-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.330288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.330268    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.332966 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.332948    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/97225a65-c434-4f21-8a61-80e50eb79cc9-secret-thanos-querier-tls\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.341970 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.341951    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2r45\" (UniqueName: \"kubernetes.io/projected/97225a65-c434-4f21-8a61-80e50eb79cc9-kube-api-access-z2r45\") pod \"thanos-querier-8574cd8b8c-v4nxc\" (UID: \"97225a65-c434-4f21-8a61-80e50eb79cc9\") " pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.450043 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.449902    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:48.581336 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.581297    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"]
Aug 05 16:22:48.583715 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:48.583688    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97225a65_c434_4f21_8a61_80e50eb79cc9.slice/crio-e1f1e4b85516031a39d135749e96221729d3c948e51958cb31081e7fe68129bb WatchSource:0}: Error finding container e1f1e4b85516031a39d135749e96221729d3c948e51958cb31081e7fe68129bb: Status 404 returned error can't find the container with id e1f1e4b85516031a39d135749e96221729d3c948e51958cb31081e7fe68129bb
Aug 05 16:22:48.717206 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.717113    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh" event={"ID":"62f99e9a-a36f-4fca-9cea-64a532717b35","Type":"ContainerStarted","Data":"8cb0a8173f76e2593240cb5791bd5b7b060695731a427b921aa66536fdc15a46"}
Aug 05 16:22:48.718379 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.718357    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"e1f1e4b85516031a39d135749e96221729d3c948e51958cb31081e7fe68129bb"}
Aug 05 16:22:48.720226 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.720204    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wfbvt" event={"ID":"b73a436f-ac07-445c-94a6-f4f0e0d1143f","Type":"ContainerStarted","Data":"b021d5a460e7bdd741c12e98dab2e0aeaa1ce2bd645a4df6ae0598a14e9ced74"}
Aug 05 16:22:48.720309 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.720245    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wfbvt" event={"ID":"b73a436f-ac07-445c-94a6-f4f0e0d1143f","Type":"ContainerStarted","Data":"c8960200a8c03f263bac93eb9b074e80a2b736398583c52a5d1b1dabac46e73a"}
Aug 05 16:22:48.740250 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.740190    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6bb4d7b4dd-nm8mh" podStartSLOduration=3.070556099 podStartE2EDuration="4.74016982s" totalImagesPullingTime="1.669613721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:48.738577863 +0000 UTC m=+82.999888461" watchObservedRunningTime="2026-08-05 16:22:48.74016982 +0000 UTC m=+83.001480419"
Aug 05 16:22:48.763102 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:48.763059    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wfbvt" podStartSLOduration=3.00800705 podStartE2EDuration="4.763045901s" totalImagesPullingTime="1.691151347s" totalInitContainerRuntime="63.887504ms" isStatefulPod=true podCreationTimestamp="2026-08-05 16:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:48.761831851 +0000 UTC m=+83.023142450" watchObservedRunningTime="2026-08-05 16:22:48.763045901 +0000 UTC m=+83.024356498"
Aug 05 16:22:49.986923 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.986883    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:22:49.989364 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.989317    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:49.991922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.991893    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-j6m4h\""
Aug 05 16:22:49.992476 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.992455    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Aug 05 16:22:49.992850 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.992827    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Aug 05 16:22:49.993053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.993035    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Aug 05 16:22:49.993168 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.993142    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Aug 05 16:22:49.993555 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.993529    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Aug 05 16:22:49.993888 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.993842    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Aug 05 16:22:49.998678 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.998289    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Aug 05 16:22:49.998678 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:49.998644    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Aug 05 16:22:50.012473 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.012449    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:22:50.142023 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.141985    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142023 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142022    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142239 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142049    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142239 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142135    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142239 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142178    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142239 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142213    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.142424 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.142261    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7mqk\" (UniqueName: \"kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243403    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243446    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243466    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243757 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243505    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243757 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243538    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.243757 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243577    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.244319 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.243947    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7mqk\" (UniqueName: \"kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.244319 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.244256    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.244319 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.244268    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.244781 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.244755    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.244969 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.244941    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.246573 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.246544    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.247077 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.247048    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.260983 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.260950    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7mqk\" (UniqueName: \"kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk\") pod \"console-c86956b5d-xnsts\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") " pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.301879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.301848    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:22:50.932243 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:50.932216    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:22:50.936811 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:22:50.936785    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd59bc25_fc8a_4fa1_a68d_4a0a12c3b1a5.slice/crio-2e59de3a608f4136052d3cfff475778d3535d50b3b75543503a090e8e262d89f WatchSource:0}: Error finding container 2e59de3a608f4136052d3cfff475778d3535d50b3b75543503a090e8e262d89f: Status 404 returned error can't find the container with id 2e59de3a608f4136052d3cfff475778d3535d50b3b75543503a090e8e262d89f
Aug 05 16:22:51.736764 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:51.736719    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c86956b5d-xnsts" event={"ID":"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5","Type":"ContainerStarted","Data":"2e59de3a608f4136052d3cfff475778d3535d50b3b75543503a090e8e262d89f"}
Aug 05 16:22:51.740931 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:51.740716    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"6cdf78e432d79885f8b64c7f04c38c88524022a120ad12586764c9cedf8f38b2"}
Aug 05 16:22:51.740931 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:51.740795    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"719295ffe77d47362039975ccb5bb39b299e6df4cdc9f16fc9a3fc74124ac002"}
Aug 05 16:22:51.740931 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:51.740841    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"c5fffc7c2158549b22b1650892d4ac28af6d43940bf436738122a3abeb211680"}
Aug 05 16:22:52.748597 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:52.748551    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"628364d1024a9f620294869565390ea892a07325a61a4c78faa5a47d79aaf3cd"}
Aug 05 16:22:52.749038 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:52.748643    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"a485f23805a24211ac40153065480d047ce0862109b3ec306382cd54f814395e"}
Aug 05 16:22:52.749038 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:52.748671    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" event={"ID":"97225a65-c434-4f21-8a61-80e50eb79cc9","Type":"ContainerStarted","Data":"ffb5b543b8cd01c354b53b271be5ceee551155f93df7ffc4d788dc29b2ff9656"}
Aug 05 16:22:52.749038 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:52.748757    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:22:52.776050 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:52.775991    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc" podStartSLOduration=1.5125413079999999 podStartE2EDuration="4.775973795s" totalImagesPullingTime="3.263432487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:52.775103177 +0000 UTC m=+87.036413777" watchObservedRunningTime="2026-08-05 16:22:52.775973795 +0000 UTC m=+87.037284394"
Aug 05 16:22:54.759140 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:54.759104    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c86956b5d-xnsts" event={"ID":"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5","Type":"ContainerStarted","Data":"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"}
Aug 05 16:22:54.783717 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:54.783669    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c86956b5d-xnsts" podStartSLOduration=2.933378296 podStartE2EDuration="5.783654888s" totalImagesPullingTime="2.850276592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:22:54.781934946 +0000 UTC m=+89.043245540" watchObservedRunningTime="2026-08-05 16:22:54.783654888 +0000 UTC m=+89.044965486"
Aug 05 16:22:58.668805 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:58.668770    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6f78d4bd5c-v6kcn"
Aug 05 16:22:58.758730 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:22:58.758707    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8574cd8b8c-v4nxc"
Aug 05 16:23:00.030136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.030099    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" podUID="4450e43b-d942-4ddc-b211-06455dcc8180" containerName="registry" containerID="cri-o://76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d" gracePeriod=30
Aug 05 16:23:00.278467 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.278444    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:23:00.302630 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.302543    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:23:00.302761 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.302659    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:23:00.311100 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.311074    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:23:00.430598 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430541    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430598 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430606    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430644    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430675    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430694    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430718    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430749    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.430856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.430778    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9fr7n\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n\") pod \"4450e43b-d942-4ddc-b211-06455dcc8180\" (UID: \"4450e43b-d942-4ddc-b211-06455dcc8180\") "
Aug 05 16:23:00.431140 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.431056    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:00.431140 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.431104    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:23:00.431243 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.431176    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-trusted-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.433412 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.433380    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:00.433544 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.433456    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:00.433544 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.433498    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n" (OuterVolumeSpecName: "kube-api-access-9fr7n") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "kube-api-access-9fr7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:00.433639 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.433594    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:23:00.433639 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.433597    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:23:00.439655 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.439633    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4450e43b-d942-4ddc-b211-06455dcc8180" (UID: "4450e43b-d942-4ddc-b211-06455dcc8180"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:23:00.531691 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531655    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9fr7n\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-kube-api-access-9fr7n\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531691 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531685    2546 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4450e43b-d942-4ddc-b211-06455dcc8180-ca-trust-extracted\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531691 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531694    2546 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-bound-sa-token\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531703    2546 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4450e43b-d942-4ddc-b211-06455dcc8180-registry-certificates\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531714    2546 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-image-registry-private-configuration\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531723    2546 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4450e43b-d942-4ddc-b211-06455dcc8180-installation-pull-secrets\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.531879 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.531731    2546 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4450e43b-d942-4ddc-b211-06455dcc8180-registry-tls\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:23:00.783246 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.783214    2546 generic.go:356] "Generic (PLEG): container finished" podID="4450e43b-d942-4ddc-b211-06455dcc8180" containerID="76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d" exitCode=0
Aug 05 16:23:00.783457 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.783259    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"
Aug 05 16:23:00.783457 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.783297    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" event={"ID":"4450e43b-d942-4ddc-b211-06455dcc8180","Type":"ContainerDied","Data":"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"}
Aug 05 16:23:00.783457 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.783369    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fcc4c47f9-nwqt6" event={"ID":"4450e43b-d942-4ddc-b211-06455dcc8180","Type":"ContainerDied","Data":"b45a5734e09c123ef522b01dfcfa30e3eca217be4138629759f3b07e98dbfaf7"}
Aug 05 16:23:00.783457 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.783391    2546 scope.go:117] "RemoveContainer" containerID="76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"
Aug 05 16:23:00.788665 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.788639    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:23:00.791695 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.791631    2546 scope.go:117] "RemoveContainer" containerID="76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"
Aug 05 16:23:00.791993 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:23:00.791963    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d\": container with ID starting with 76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d not found: ID does not exist" containerID="76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"
Aug 05 16:23:00.792096 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.791998    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d"} err="failed to get container status \"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d\": rpc error: code = NotFound desc = could not find container \"76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d\": container with ID starting with 76fc9b2b25e2da2755708863fb0a928ba5b0e5cbedf73d37b45703b5b1c8ea8d not found: ID does not exist"
Aug 05 16:23:00.827143 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.827112    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:23:00.834922 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:00.834892    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6fcc4c47f9-nwqt6"]
Aug 05 16:23:02.308783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:02.308750    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4450e43b-d942-4ddc-b211-06455dcc8180" path="/var/lib/kubelet/pods/4450e43b-d942-4ddc-b211-06455dcc8180/volumes"
Aug 05 16:23:07.659124 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:07.659093    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lkcd8"
Aug 05 16:23:16.845145 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:16.845110    2546 generic.go:356] "Generic (PLEG): container finished" podID="45be7fc4-a472-4a10-96ed-336064a45184" containerID="f41f3a0b33ed1d05a434a4bd218a7cdd7f05b92387276d2b23fcd29de3b65dec" exitCode=0
Aug 05 16:23:16.845624 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:16.845185    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c" event={"ID":"45be7fc4-a472-4a10-96ed-336064a45184","Type":"ContainerDied","Data":"f41f3a0b33ed1d05a434a4bd218a7cdd7f05b92387276d2b23fcd29de3b65dec"}
Aug 05 16:23:16.845624 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:16.845528    2546 scope.go:117] "RemoveContainer" containerID="f41f3a0b33ed1d05a434a4bd218a7cdd7f05b92387276d2b23fcd29de3b65dec"
Aug 05 16:23:17.851175 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:17.851144    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7878f4b88c-54g4c" event={"ID":"45be7fc4-a472-4a10-96ed-336064a45184","Type":"ContainerStarted","Data":"97288e362ce2b564025dc995b46e2a9162cb5046b34d42e1ff8fdfd083f9536d"}
Aug 05 16:23:40.936980 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:40.936896    2546 generic.go:356] "Generic (PLEG): container finished" podID="500f22c1-607f-4cc9-8e24-dad8fcbf5a28" containerID="ed552e025608377a3068e1df2567f0ff38032a272cbf84282bcd3d7e678af766" exitCode=0
Aug 05 16:23:40.936980 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:40.936948    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-2p9n8" event={"ID":"500f22c1-607f-4cc9-8e24-dad8fcbf5a28","Type":"ContainerDied","Data":"ed552e025608377a3068e1df2567f0ff38032a272cbf84282bcd3d7e678af766"}
Aug 05 16:23:40.937381 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:40.937263    2546 scope.go:117] "RemoveContainer" containerID="ed552e025608377a3068e1df2567f0ff38032a272cbf84282bcd3d7e678af766"
Aug 05 16:23:41.942465 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:23:41.942427    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-77696685b-2p9n8" event={"ID":"500f22c1-607f-4cc9-8e24-dad8fcbf5a28","Type":"ContainerStarted","Data":"72f40b16f55a884aba8d306b6aa3a51761f37007713a1b5385f2d2faa3b136fd"}
Aug 05 16:24:13.284650 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.284615    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:24:13.285809 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.285776    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4450e43b-d942-4ddc-b211-06455dcc8180" containerName="registry"
Aug 05 16:24:13.285957 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.285946    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4450e43b-d942-4ddc-b211-06455dcc8180" containerName="registry"
Aug 05 16:24:13.286115 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.286104    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4450e43b-d942-4ddc-b211-06455dcc8180" containerName="registry"
Aug 05 16:24:13.289589 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.289568    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.302017 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.301987    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:24:13.313867 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313841    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvqkr\" (UniqueName: \"kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.313987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313880    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.313987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313904    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.313987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313938    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.313987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313957    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.314178 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.313989    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.314178 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.314087    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414533 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414497    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414533 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414544    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414813 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414563    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvqkr\" (UniqueName: \"kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414813 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414667    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414813 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414715    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414813 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414749    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.414813 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.414778    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.415312 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.415275    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.415497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.415477    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.415564 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.415508    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.415844 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.415817    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.417178 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.417149    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.417274 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.417259    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.424693 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.424669    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvqkr\" (UniqueName: \"kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr\") pod \"console-595b88f797-wwvcg\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") " pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.600211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.600172    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:13.749761 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:13.749740    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:24:13.752431 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:24:13.752401    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6e756b_08d2_4449_86f3_b2f88f086a96.slice/crio-c3fab58f849c8874797eedeef901a178e9ba913a2f3774da481b1751533f4944 WatchSource:0}: Error finding container c3fab58f849c8874797eedeef901a178e9ba913a2f3774da481b1751533f4944: Status 404 returned error can't find the container with id c3fab58f849c8874797eedeef901a178e9ba913a2f3774da481b1751533f4944
Aug 05 16:24:14.066984 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:14.066894    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b88f797-wwvcg" event={"ID":"8b6e756b-08d2-4449-86f3-b2f88f086a96","Type":"ContainerStarted","Data":"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"}
Aug 05 16:24:14.066984 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:14.066953    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b88f797-wwvcg" event={"ID":"8b6e756b-08d2-4449-86f3-b2f88f086a96","Type":"ContainerStarted","Data":"c3fab58f849c8874797eedeef901a178e9ba913a2f3774da481b1751533f4944"}
Aug 05 16:24:23.600681 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:23.600597    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:23.601046 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:23.600685    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:23.605405 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:23.605383    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:23.623006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:23.622961    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595b88f797-wwvcg" podStartSLOduration=10.622947957000001 podStartE2EDuration="10.622947957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:24:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:24:14.089384332 +0000 UTC m=+168.350694931" watchObservedRunningTime="2026-08-05 16:24:23.622947957 +0000 UTC m=+177.884258554"
Aug 05 16:24:24.105661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:24.105630    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:24:24.152866 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:24.152833    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:24:49.172725 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.172683    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c86956b5d-xnsts" podUID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" containerName="console" containerID="cri-o://e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907" gracePeriod=15
Aug 05 16:24:49.409125 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.409100    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:24:49.515910 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.515832    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516046 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.515866    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516046 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.515990    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516129 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516058    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516185 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516135    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7mqk\" (UniqueName: \"kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516237 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516184    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516237 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516209    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config\") pod \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\" (UID: \"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5\") "
Aug 05 16:24:49.516625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516396    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:49.516625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516450    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config" (OuterVolumeSpecName: "console-config") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:49.516625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516526    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-oauth-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.516625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516547    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.516625 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516590    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:49.516848 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.516635    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:24:49.518101 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.518083    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:49.518229 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.518207    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:24:49.518360 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.518308    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk" (OuterVolumeSpecName: "kube-api-access-d7mqk") pod "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" (UID: "bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5"). InnerVolumeSpecName "kube-api-access-d7mqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:24:49.617810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.617771    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-trusted-ca-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.617810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.617803    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7mqk\" (UniqueName: \"kubernetes.io/projected/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-kube-api-access-d7mqk\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.617810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.617818    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.618026 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.617830    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-oauth-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:49.618026 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:49.617841    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5-console-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:24:50.201586 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.201544    2546 generic.go:356] "Generic (PLEG): container finished" podID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" containerID="e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907" exitCode=0
Aug 05 16:24:50.201586 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.201587    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c86956b5d-xnsts"
Aug 05 16:24:50.202053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.201624    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c86956b5d-xnsts" event={"ID":"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5","Type":"ContainerDied","Data":"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"}
Aug 05 16:24:50.202053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.201699    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c86956b5d-xnsts" event={"ID":"bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5","Type":"ContainerDied","Data":"2e59de3a608f4136052d3cfff475778d3535d50b3b75543503a090e8e262d89f"}
Aug 05 16:24:50.202053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.201720    2546 scope.go:117] "RemoveContainer" containerID="e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"
Aug 05 16:24:50.210224 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.210207    2546 scope.go:117] "RemoveContainer" containerID="e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"
Aug 05 16:24:50.210496 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:24:50.210477    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907\": container with ID starting with e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907 not found: ID does not exist" containerID="e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"
Aug 05 16:24:50.210569 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.210504    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907"} err="failed to get container status \"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907\": rpc error: code = NotFound desc = could not find container \"e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907\": container with ID starting with e4134791ca71be3947d1eed0721bc3c3b6db0ef0851365a1b58ab0f3001d8907 not found: ID does not exist"
Aug 05 16:24:50.223118 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.223092    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:24:50.229134 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.229111    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c86956b5d-xnsts"]
Aug 05 16:24:50.308495 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:24:50.308468    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" path="/var/lib/kubelet/pods/bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5/volumes"
Aug 05 16:25:21.170773 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.170741    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:25:21.171210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.171070    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" containerName="console"
Aug 05 16:25:21.171210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.171089    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" containerName="console"
Aug 05 16:25:21.171210 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.171167    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd59bc25-fc8a-4fa1-a68d-4a0a12c3b1a5" containerName="console"
Aug 05 16:25:21.173555 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.173535    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.187894 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.187871    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:25:21.264833 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264802    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.264998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264842    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.264998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264878    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.264998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264924    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.264998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264960    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gblqq\" (UniqueName: \"kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.264998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.264977    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.265180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.265001    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366043 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366014    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gblqq\" (UniqueName: \"kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366043 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366047    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366314 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366070    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366314 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366314 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366169    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366314 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366231    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366314 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366262    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.366893 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366866    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.367037 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.366982    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.367037 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.367016    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.367278 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.367259    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.368640 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.368621    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.368745 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.368729    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.375767 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.375749    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gblqq\" (UniqueName: \"kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq\") pod \"console-595c89bf85-njtrd\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") " pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.482522 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.482437    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:21.610167 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:21.610140    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:25:21.612754 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:25:21.612728    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3860e8e1_57f2_4cff_a439_8931a108c897.slice/crio-ac0103f6a1baf8ded6274f66a59cbc37e5973c30a7761f55ed3e8108a3acb697 WatchSource:0}: Error finding container ac0103f6a1baf8ded6274f66a59cbc37e5973c30a7761f55ed3e8108a3acb697: Status 404 returned error can't find the container with id ac0103f6a1baf8ded6274f66a59cbc37e5973c30a7761f55ed3e8108a3acb697
Aug 05 16:25:22.323360 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:22.323315    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c89bf85-njtrd" event={"ID":"3860e8e1-57f2-4cff-a439-8931a108c897","Type":"ContainerStarted","Data":"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"}
Aug 05 16:25:22.323360 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:22.323366    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c89bf85-njtrd" event={"ID":"3860e8e1-57f2-4cff-a439-8931a108c897","Type":"ContainerStarted","Data":"ac0103f6a1baf8ded6274f66a59cbc37e5973c30a7761f55ed3e8108a3acb697"}
Aug 05 16:25:22.342434 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:22.342389    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-595c89bf85-njtrd" podStartSLOduration=1.342376315 podStartE2EDuration="1.342376315s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:25:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:25:22.341978166 +0000 UTC m=+236.603288789" watchObservedRunningTime="2026-08-05 16:25:22.342376315 +0000 UTC m=+236.603686913"
Aug 05 16:25:31.483577 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:31.483541    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:31.483971 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:31.483611    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:31.488267 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:31.488240    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:32.361705 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:32.361675    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:25:32.411987 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:32.411947    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:25:57.431287 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.431198    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-595b88f797-wwvcg" podUID="8b6e756b-08d2-4449-86f3-b2f88f086a96" containerName="console" containerID="cri-o://cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990" gracePeriod=15
Aug 05 16:25:57.675580 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.675557    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:25:57.773719 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773629    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773719 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773688    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773723    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773750    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hvqkr\" (UniqueName: \"kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773781    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773856    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.773950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.773910    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config\") pod \"8b6e756b-08d2-4449-86f3-b2f88f086a96\" (UID: \"8b6e756b-08d2-4449-86f3-b2f88f086a96\") "
Aug 05 16:25:57.774197 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.774085    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:57.774272 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.774253    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-oauth-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.774379 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.774352    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:57.774458 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.774358    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca" (OuterVolumeSpecName: "service-ca") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:57.774458 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.774401    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config" (OuterVolumeSpecName: "console-config") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:25:57.775969 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.775937    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:57.776070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.775981    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr" (OuterVolumeSpecName: "kube-api-access-hvqkr") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "kube-api-access-hvqkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:25:57.776070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.776024    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8b6e756b-08d2-4449-86f3-b2f88f086a96" (UID: "8b6e756b-08d2-4449-86f3-b2f88f086a96"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:25:57.875660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875623    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.875660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875652    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-oauth-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.875660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875661    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8b6e756b-08d2-4449-86f3-b2f88f086a96-console-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.875660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875670    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hvqkr\" (UniqueName: \"kubernetes.io/projected/8b6e756b-08d2-4449-86f3-b2f88f086a96-kube-api-access-hvqkr\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.875919 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875680    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:57.875919 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:57.875699    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b6e756b-08d2-4449-86f3-b2f88f086a96-trusted-ca-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:25:58.452765 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.452732    2546 generic.go:356] "Generic (PLEG): container finished" podID="8b6e756b-08d2-4449-86f3-b2f88f086a96" containerID="cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990" exitCode=0
Aug 05 16:25:58.453211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.452848    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595b88f797-wwvcg"
Aug 05 16:25:58.453211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.452850    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b88f797-wwvcg" event={"ID":"8b6e756b-08d2-4449-86f3-b2f88f086a96","Type":"ContainerDied","Data":"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"}
Aug 05 16:25:58.453211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.452910    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595b88f797-wwvcg" event={"ID":"8b6e756b-08d2-4449-86f3-b2f88f086a96","Type":"ContainerDied","Data":"c3fab58f849c8874797eedeef901a178e9ba913a2f3774da481b1751533f4944"}
Aug 05 16:25:58.453211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.452939    2546 scope.go:117] "RemoveContainer" containerID="cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"
Aug 05 16:25:58.465290 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.465261    2546 scope.go:117] "RemoveContainer" containerID="cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"
Aug 05 16:25:58.465789 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:25:58.465764    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990\": container with ID starting with cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990 not found: ID does not exist" containerID="cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"
Aug 05 16:25:58.465870 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.465796    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990"} err="failed to get container status \"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990\": rpc error: code = NotFound desc = could not find container \"cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990\": container with ID starting with cc3cb96b7f3b81d5c9ab0695326074c00bd6906d15b886757135d7e36c58d990 not found: ID does not exist"
Aug 05 16:25:58.470972 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.470950    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:25:58.475846 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:25:58.475828    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595b88f797-wwvcg"]
Aug 05 16:26:00.308946 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:26:00.308912    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b6e756b-08d2-4449-86f3-b2f88f086a96" path="/var/lib/kubelet/pods/8b6e756b-08d2-4449-86f3-b2f88f086a96/volumes"
Aug 05 16:26:26.151662 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:26:26.151629    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:26:26.152111 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:26:26.151794    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:26:26.162260 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:26:26.162238    2546 kubelet.go:1648] "Image garbage collection succeeded"
Aug 05 16:27:06.349431 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.349395    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"]
Aug 05 16:27:06.351831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.349686    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b6e756b-08d2-4449-86f3-b2f88f086a96" containerName="console"
Aug 05 16:27:06.351831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.349696    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b6e756b-08d2-4449-86f3-b2f88f086a96" containerName="console"
Aug 05 16:27:06.351831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.349749    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b6e756b-08d2-4449-86f3-b2f88f086a96" containerName="console"
Aug 05 16:27:06.352760 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.352732    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.354834 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.354812    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7jrs\""
Aug 05 16:27:06.355029 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.355014    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:27:06.355334 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.355306    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:27:06.364760 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.364730    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"]
Aug 05 16:27:06.415676 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.415644    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.415824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.415697    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.415824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.415751    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr4w6\" (UniqueName: \"kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.516193 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.516164    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr4w6\" (UniqueName: \"kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.516386 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.516220    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.516386 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.516272    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.516606 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.516589    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.516641 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.516621    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.524558 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.524531    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr4w6\" (UniqueName: \"kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.662058 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.661986    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:06.789910 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.789836    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"]
Aug 05 16:27:06.792501 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:06.792459    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b5d4d77_c7ba_411c_8afa_395d590c2f85.slice/crio-092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f WatchSource:0}: Error finding container 092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f: Status 404 returned error can't find the container with id 092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f
Aug 05 16:27:06.794427 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:06.794411    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:27:07.714656 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:07.714615    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn" event={"ID":"4b5d4d77-c7ba-411c-8afa-395d590c2f85","Type":"ContainerStarted","Data":"092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f"}
Aug 05 16:27:13.740926 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:13.740890    2546 generic.go:356] "Generic (PLEG): container finished" podID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerID="b45a38329bf4bf351a48023c7ff41f0c1e0d0b0a12d0cf6f1517f3854074d1b6" exitCode=0
Aug 05 16:27:13.741295 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:13.740938    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn" event={"ID":"4b5d4d77-c7ba-411c-8afa-395d590c2f85","Type":"ContainerDied","Data":"b45a38329bf4bf351a48023c7ff41f0c1e0d0b0a12d0cf6f1517f3854074d1b6"}
Aug 05 16:27:16.754969 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:16.754930    2546 generic.go:356] "Generic (PLEG): container finished" podID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerID="fbceac7faeea9b5b2db405f4f92c6450067e2bc2e5f7c5a8ebdc46c5673e385f" exitCode=0
Aug 05 16:27:16.755374 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:16.755012    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn" event={"ID":"4b5d4d77-c7ba-411c-8afa-395d590c2f85","Type":"ContainerDied","Data":"fbceac7faeea9b5b2db405f4f92c6450067e2bc2e5f7c5a8ebdc46c5673e385f"}
Aug 05 16:27:23.786883 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:23.786799    2546 generic.go:356] "Generic (PLEG): container finished" podID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerID="b451c202a61a8c24774a4bb154905cd17a75a72ee295be14d8130508a641fc99" exitCode=0
Aug 05 16:27:23.787221 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:23.786882    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn" event={"ID":"4b5d4d77-c7ba-411c-8afa-395d590c2f85","Type":"ContainerDied","Data":"b451c202a61a8c24774a4bb154905cd17a75a72ee295be14d8130508a641fc99"}
Aug 05 16:27:24.911817 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.911792    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:24.976402 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.976371    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util\") pod \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") "
Aug 05 16:27:24.976574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.976436    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nr4w6\" (UniqueName: \"kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6\") pod \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") "
Aug 05 16:27:24.976574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.976531    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle\") pod \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\" (UID: \"4b5d4d77-c7ba-411c-8afa-395d590c2f85\") "
Aug 05 16:27:24.977246 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.977213    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle" (OuterVolumeSpecName: "bundle") pod "4b5d4d77-c7ba-411c-8afa-395d590c2f85" (UID: "4b5d4d77-c7ba-411c-8afa-395d590c2f85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:24.978614 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.978589    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6" (OuterVolumeSpecName: "kube-api-access-nr4w6") pod "4b5d4d77-c7ba-411c-8afa-395d590c2f85" (UID: "4b5d4d77-c7ba-411c-8afa-395d590c2f85"). InnerVolumeSpecName "kube-api-access-nr4w6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:27:24.981140 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:24.981120    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util" (OuterVolumeSpecName: "util") pod "4b5d4d77-c7ba-411c-8afa-395d590c2f85" (UID: "4b5d4d77-c7ba-411c-8afa-395d590c2f85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:25.077525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.077442    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nr4w6\" (UniqueName: \"kubernetes.io/projected/4b5d4d77-c7ba-411c-8afa-395d590c2f85-kube-api-access-nr4w6\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:25.077525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.077470    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:25.077525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.077481    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4b5d4d77-c7ba-411c-8afa-395d590c2f85-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:25.796142 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.796117    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn"
Aug 05 16:27:25.796294 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.796115    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540th5zn" event={"ID":"4b5d4d77-c7ba-411c-8afa-395d590c2f85","Type":"ContainerDied","Data":"092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f"}
Aug 05 16:27:25.796294 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:25.796230    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="092018d1e9ba61536546cf0a58b2561e40107f2aeb50956d220f7e99229a4d3f"
Aug 05 16:27:29.747551 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747520    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"]
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747797    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="extract"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747808    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="extract"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747828    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="util"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747834    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="util"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747840    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="pull"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747846    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="pull"
Aug 05 16:27:29.747916 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.747893    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b5d4d77-c7ba-411c-8afa-395d590c2f85" containerName="extract"
Aug 05 16:27:29.791574 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.791544    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"]
Aug 05 16:27:29.791716 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.791635    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:29.797270 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.797250    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Aug 05 16:27:29.797423 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.797257    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:27:29.797557 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.797540    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v4ncp\""
Aug 05 16:27:29.917161 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.917131    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:29.917395 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:29.917195    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hmhr\" (UniqueName: \"kubernetes.io/projected/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-kube-api-access-6hmhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.018467 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.018381    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.018612 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.018474    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hmhr\" (UniqueName: \"kubernetes.io/projected/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-kube-api-access-6hmhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.018810 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.018773    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.029577 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.029556    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hmhr\" (UniqueName: \"kubernetes.io/projected/e0c98a46-9a92-4fd8-b5d9-6655ee8adea2-kube-api-access-6hmhr\") pod \"cert-manager-operator-controller-manager-55c444bf86-6tsmd\" (UID: \"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.100731 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.100696    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"
Aug 05 16:27:30.262224 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.262190    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd"]
Aug 05 16:27:30.265314 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:30.265288    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0c98a46_9a92_4fd8_b5d9_6655ee8adea2.slice/crio-f2792a2c5c88193b629727d03a90c0b4af0b15edcd3a51b00b98ca99adcb34d6 WatchSource:0}: Error finding container f2792a2c5c88193b629727d03a90c0b4af0b15edcd3a51b00b98ca99adcb34d6: Status 404 returned error can't find the container with id f2792a2c5c88193b629727d03a90c0b4af0b15edcd3a51b00b98ca99adcb34d6
Aug 05 16:27:30.819049 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:30.819012    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd" event={"ID":"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2","Type":"ContainerStarted","Data":"f2792a2c5c88193b629727d03a90c0b4af0b15edcd3a51b00b98ca99adcb34d6"}
Aug 05 16:27:32.836093 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:32.836057    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd" event={"ID":"e0c98a46-9a92-4fd8-b5d9-6655ee8adea2","Type":"ContainerStarted","Data":"19ee83aface1244100a86a7076f748ac2aa5f08f5552843fd545863146b3d1f1"}
Aug 05 16:27:32.883052 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:32.881935    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6tsmd" podStartSLOduration=1.878496484 podStartE2EDuration="3.881912607s" totalImagesPullingTime="2.003416123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:27:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:27:32.880135737 +0000 UTC m=+367.141446336" watchObservedRunningTime="2026-08-05 16:27:32.881912607 +0000 UTC m=+367.143223206"
Aug 05 16:27:33.882276 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.882242    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dvqwn"]
Aug 05 16:27:33.896887 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.896850    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dvqwn"]
Aug 05 16:27:33.897004 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.896895    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:33.899529 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.899502    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Aug 05 16:27:33.899651 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.899600    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-295jm\""
Aug 05 16:27:33.900075 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:33.900053    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Aug 05 16:27:34.054623 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.054591    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhmn\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-kube-api-access-4bhmn\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.054623 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.054627    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.111971 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.111937    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"]
Aug 05 16:27:34.114884 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.114867    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.120446 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.120424    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:27:34.120561 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.120478    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7jrs\""
Aug 05 16:27:34.121191 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.121167    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:27:34.134273 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.134212    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"]
Aug 05 16:27:34.155536 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.155489    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhmn\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-kube-api-access-4bhmn\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.155536 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.155524    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.179196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.179158    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhmn\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-kube-api-access-4bhmn\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.180282 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.180263    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/015cc692-4ba3-432d-817b-f7e90507b2f0-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dvqwn\" (UID: \"015cc692-4ba3-432d-817b-f7e90507b2f0\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.215376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.215350    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:34.256734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.256700    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.256915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.256747    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws6xq\" (UniqueName: \"kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.256915 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.256867    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.344097 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.344066    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dvqwn"]
Aug 05 16:27:34.347203 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:34.347171    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod015cc692_4ba3_432d_817b_f7e90507b2f0.slice/crio-3f0dfee2b8db91917aec94c36775f60ea019896c35ab769bbe07ab6d26ae3309 WatchSource:0}: Error finding container 3f0dfee2b8db91917aec94c36775f60ea019896c35ab769bbe07ab6d26ae3309: Status 404 returned error can't find the container with id 3f0dfee2b8db91917aec94c36775f60ea019896c35ab769bbe07ab6d26ae3309
Aug 05 16:27:34.357937 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.357914    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.358022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.357956    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws6xq\" (UniqueName: \"kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.358022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.358009    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.358248 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.358230    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.358288 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.358268    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.370245 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.370224    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws6xq\" (UniqueName: \"kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.423526 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.423449    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:34.554509 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.554482    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"]
Aug 05 16:27:34.556369 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:34.556341    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11e6361f_07b4_4f38_bd0a_80196e41b626.slice/crio-75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d WatchSource:0}: Error finding container 75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d: Status 404 returned error can't find the container with id 75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d
Aug 05 16:27:34.847520 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.847490    2546 generic.go:356] "Generic (PLEG): container finished" podID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerID="cbaed30143f758a35ecbc169e3372acf9cf8f44771171d9975f0fbd5a6b75d4e" exitCode=0
Aug 05 16:27:34.847713 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.847608    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n" event={"ID":"11e6361f-07b4-4f38-bd0a-80196e41b626","Type":"ContainerDied","Data":"cbaed30143f758a35ecbc169e3372acf9cf8f44771171d9975f0fbd5a6b75d4e"}
Aug 05 16:27:34.847713 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.847656    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n" event={"ID":"11e6361f-07b4-4f38-bd0a-80196e41b626","Type":"ContainerStarted","Data":"75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d"}
Aug 05 16:27:34.848944 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:34.848918    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn" event={"ID":"015cc692-4ba3-432d-817b-f7e90507b2f0","Type":"ContainerStarted","Data":"3f0dfee2b8db91917aec94c36775f60ea019896c35ab769bbe07ab6d26ae3309"}
Aug 05 16:27:37.864017 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:37.863982    2546 generic.go:356] "Generic (PLEG): container finished" podID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerID="d439d3046ff94e7683a89d975212816fd100839def3cce53d9e57af4f1fb987c" exitCode=0
Aug 05 16:27:37.864548 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:37.864065    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n" event={"ID":"11e6361f-07b4-4f38-bd0a-80196e41b626","Type":"ContainerDied","Data":"d439d3046ff94e7683a89d975212816fd100839def3cce53d9e57af4f1fb987c"}
Aug 05 16:27:37.865665 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:37.865582    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn" event={"ID":"015cc692-4ba3-432d-817b-f7e90507b2f0","Type":"ContainerStarted","Data":"28ce91186cd790a9bb98b152c9aad085a9adfa3edae39af0a1d27ac5c3ab57d3"}
Aug 05 16:27:37.865726 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:37.865695    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:37.900876 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:37.900826    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn" podStartSLOduration=1.758730589 podStartE2EDuration="4.900809903s" totalImagesPullingTime="3.142079314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:27:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:27:37.90008103 +0000 UTC m=+372.161391629" watchObservedRunningTime="2026-08-05 16:27:37.900809903 +0000 UTC m=+372.162120501"
Aug 05 16:27:38.871730 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:38.871664    2546 generic.go:356] "Generic (PLEG): container finished" podID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerID="8bafa134614c3c15ebe99eadccf08e83cb23da7c3ff5ae51d2dc4c96962caad5" exitCode=0
Aug 05 16:27:38.872177 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:38.871748    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n" event={"ID":"11e6361f-07b4-4f38-bd0a-80196e41b626","Type":"ContainerDied","Data":"8bafa134614c3c15ebe99eadccf08e83cb23da7c3ff5ae51d2dc4c96962caad5"}
Aug 05 16:27:40.003753 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.003727    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:40.106998 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.106961    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws6xq\" (UniqueName: \"kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq\") pod \"11e6361f-07b4-4f38-bd0a-80196e41b626\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") "
Aug 05 16:27:40.107153 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.107060    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle\") pod \"11e6361f-07b4-4f38-bd0a-80196e41b626\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") "
Aug 05 16:27:40.107153 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.107147    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util\") pod \"11e6361f-07b4-4f38-bd0a-80196e41b626\" (UID: \"11e6361f-07b4-4f38-bd0a-80196e41b626\") "
Aug 05 16:27:40.107493 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.107468    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle" (OuterVolumeSpecName: "bundle") pod "11e6361f-07b4-4f38-bd0a-80196e41b626" (UID: "11e6361f-07b4-4f38-bd0a-80196e41b626"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:40.109119 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.109092    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq" (OuterVolumeSpecName: "kube-api-access-ws6xq") pod "11e6361f-07b4-4f38-bd0a-80196e41b626" (UID: "11e6361f-07b4-4f38-bd0a-80196e41b626"). InnerVolumeSpecName "kube-api-access-ws6xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:27:40.204541 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.204437    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util" (OuterVolumeSpecName: "util") pod "11e6361f-07b4-4f38-bd0a-80196e41b626" (UID: "11e6361f-07b4-4f38-bd0a-80196e41b626"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:40.208449 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.208428    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:40.208498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.208452    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws6xq\" (UniqueName: \"kubernetes.io/projected/11e6361f-07b4-4f38-bd0a-80196e41b626-kube-api-access-ws6xq\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:40.208498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.208463    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/11e6361f-07b4-4f38-bd0a-80196e41b626-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:40.881495 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.881458    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n" event={"ID":"11e6361f-07b4-4f38-bd0a-80196e41b626","Type":"ContainerDied","Data":"75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d"}
Aug 05 16:27:40.881657 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.881504    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ft5q8n"
Aug 05 16:27:40.881657 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:40.881515    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75d881ce268b85d6498eeef59cb5b0294ee8cba1c606e0209bb769a43857f76d"
Aug 05 16:27:43.873905 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:43.873873    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dvqwn"
Aug 05 16:27:44.892972 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.892939    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d7d988cdd-tk7px"]
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893236    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="pull"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893246    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="pull"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893261    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="extract"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893266    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="extract"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893280    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="util"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893286    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="util"
Aug 05 16:27:44.893498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.893359    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="11e6361f-07b4-4f38-bd0a-80196e41b626" containerName="extract"
Aug 05 16:27:44.896200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.896177    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:44.913618 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:44.913583    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7d988cdd-tk7px"]
Aug 05 16:27:45.047729 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047689    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-oauth-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.047945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047748    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph9b2\" (UniqueName: \"kubernetes.io/projected/5438157e-2842-4835-b49a-8e17d5247375-kube-api-access-ph9b2\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.047945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047814    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-trusted-ca-bundle\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.047945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047893    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-console-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.047945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047930    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-oauth-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.048136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047951    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-service-ca\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.048136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.047999    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.148898 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.148796    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-console-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.148898 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.148841    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-oauth-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.148898 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.148856    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-service-ca\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149176 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.148936    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149176 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.148997    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-oauth-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149176 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.149077    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph9b2\" (UniqueName: \"kubernetes.io/projected/5438157e-2842-4835-b49a-8e17d5247375-kube-api-access-ph9b2\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149176 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.149130    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-trusted-ca-bundle\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149633 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.149608    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-service-ca\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149741 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.149672    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-console-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.149741 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.149704    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-oauth-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.150102 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.150083    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5438157e-2842-4835-b49a-8e17d5247375-trusted-ca-bundle\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.151470 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.151449    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-oauth-config\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.151562 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.151483    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5438157e-2842-4835-b49a-8e17d5247375-console-serving-cert\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.158734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.158714    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph9b2\" (UniqueName: \"kubernetes.io/projected/5438157e-2842-4835-b49a-8e17d5247375-kube-api-access-ph9b2\") pod \"console-d7d988cdd-tk7px\" (UID: \"5438157e-2842-4835-b49a-8e17d5247375\") " pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.207791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.207754    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:45.355017 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.354992    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d7d988cdd-tk7px"]
Aug 05 16:27:45.357621 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:45.357593    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5438157e_2842_4835_b49a_8e17d5247375.slice/crio-60ed2773253f29daadd8b62b0bcf3c2a95f00a3685ba2f5f8a09e069925d7ccc WatchSource:0}: Error finding container 60ed2773253f29daadd8b62b0bcf3c2a95f00a3685ba2f5f8a09e069925d7ccc: Status 404 returned error can't find the container with id 60ed2773253f29daadd8b62b0bcf3c2a95f00a3685ba2f5f8a09e069925d7ccc
Aug 05 16:27:45.906049 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.906007    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7d988cdd-tk7px" event={"ID":"5438157e-2842-4835-b49a-8e17d5247375","Type":"ContainerStarted","Data":"d8448a53ecb7987ee038b5f7546c6bef7e785ba7c7c2746517d15872e2ab0c43"}
Aug 05 16:27:45.906480 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.906067    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d7d988cdd-tk7px" event={"ID":"5438157e-2842-4835-b49a-8e17d5247375","Type":"ContainerStarted","Data":"60ed2773253f29daadd8b62b0bcf3c2a95f00a3685ba2f5f8a09e069925d7ccc"}
Aug 05 16:27:45.924724 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:45.924676    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d7d988cdd-tk7px" podStartSLOduration=1.924659669 podStartE2EDuration="1.924659669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:27:45.924083951 +0000 UTC m=+380.185394551" watchObservedRunningTime="2026-08-05 16:27:45.924659669 +0000 UTC m=+380.185970327"
Aug 05 16:27:46.654804 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.654769    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"]
Aug 05 16:27:46.657068 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.657052    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.659464 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.659418    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Aug 05 16:27:46.659945 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.659928    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Aug 05 16:27:46.660033 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.659934    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-4bfvm\""
Aug 05 16:27:46.666601 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.666581    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"]
Aug 05 16:27:46.763617 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.763576    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxkjt\" (UniqueName: \"kubernetes.io/projected/d2260aed-8317-455c-b8c5-1244cbaefcdd-kube-api-access-xxkjt\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.763617 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.763625    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2260aed-8317-455c-b8c5-1244cbaefcdd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.864896 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.864855    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2260aed-8317-455c-b8c5-1244cbaefcdd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.865070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.864948    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxkjt\" (UniqueName: \"kubernetes.io/projected/d2260aed-8317-455c-b8c5-1244cbaefcdd-kube-api-access-xxkjt\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.865306 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.865280    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d2260aed-8317-455c-b8c5-1244cbaefcdd-tmp\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.874080 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.874056    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxkjt\" (UniqueName: \"kubernetes.io/projected/d2260aed-8317-455c-b8c5-1244cbaefcdd-kube-api-access-xxkjt\") pod \"openshift-lws-operator-fd8ccff4c-f95gc\" (UID: \"d2260aed-8317-455c-b8c5-1244cbaefcdd\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:46.966424 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:46.966318    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"
Aug 05 16:27:47.102308 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:47.102286    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc"]
Aug 05 16:27:47.103812 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:47.103786    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2260aed_8317_455c_b8c5_1244cbaefcdd.slice/crio-3518f654a01169f4e75f6f0e34a440769f9d014c57b633a8cdc5ce40d3edba83 WatchSource:0}: Error finding container 3518f654a01169f4e75f6f0e34a440769f9d014c57b633a8cdc5ce40d3edba83: Status 404 returned error can't find the container with id 3518f654a01169f4e75f6f0e34a440769f9d014c57b633a8cdc5ce40d3edba83
Aug 05 16:27:47.916088 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:47.916050    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc" event={"ID":"d2260aed-8317-455c-b8c5-1244cbaefcdd","Type":"ContainerStarted","Data":"3518f654a01169f4e75f6f0e34a440769f9d014c57b633a8cdc5ce40d3edba83"}
Aug 05 16:27:49.927584 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:49.927540    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc" event={"ID":"d2260aed-8317-455c-b8c5-1244cbaefcdd","Type":"ContainerStarted","Data":"60fd9dd8799e3f0dfd4f5d6acf16181d6136b17cc3ba4bb57f775c4dfa6a4052"}
Aug 05 16:27:49.945633 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:49.945582    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-f95gc" podStartSLOduration=1.711953089 podStartE2EDuration="3.945567448s" totalImagesPullingTime="2.233614359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:27:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:27:49.944401181 +0000 UTC m=+384.205711779" watchObservedRunningTime="2026-08-05 16:27:49.945567448 +0000 UTC m=+384.206878046"
Aug 05 16:27:54.510510 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.510482    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"]
Aug 05 16:27:54.515358 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.515340    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.518937 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.518916    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7jrs\""
Aug 05 16:27:54.519233 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.519212    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:27:54.519905 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.519891    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:27:54.542353 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.542315    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"]
Aug 05 16:27:54.633542 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.633506    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pph6f\" (UniqueName: \"kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.633699 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.633562    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.633699 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.633591    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.734858 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.734816    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pph6f\" (UniqueName: \"kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.735053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.734876    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.735053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.734903    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.735279 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.735260    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.735367 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.735353    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.743726 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.743698    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pph6f\" (UniqueName: \"kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.824964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.824896    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:54.965734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:54.965707    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"]
Aug 05 16:27:54.968259 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:27:54.968228    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod965d0aed_1c5b_4609_875b_6641e9556ddd.slice/crio-9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b WatchSource:0}: Error finding container 9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b: Status 404 returned error can't find the container with id 9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b
Aug 05 16:27:55.208439 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.208409    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:55.208601 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.208475    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:55.213048 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.213026    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:55.956667 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.956632    2546 generic.go:356] "Generic (PLEG): container finished" podID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerID="418b35959c97ac84ac74f48abfde4e3f60cb4b2e286fb36c0e371c79034985d7" exitCode=0
Aug 05 16:27:55.957053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.956716    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v" event={"ID":"965d0aed-1c5b-4609-875b-6641e9556ddd","Type":"ContainerDied","Data":"418b35959c97ac84ac74f48abfde4e3f60cb4b2e286fb36c0e371c79034985d7"}
Aug 05 16:27:55.957053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.956760    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v" event={"ID":"965d0aed-1c5b-4609-875b-6641e9556ddd","Type":"ContainerStarted","Data":"9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b"}
Aug 05 16:27:55.960856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:55.960835    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d7d988cdd-tk7px"
Aug 05 16:27:56.024984 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:56.024914    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:27:56.962912 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:56.962828    2546 generic.go:356] "Generic (PLEG): container finished" podID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerID="2c9eb833f4dbf7fbfc2e0360184c7b98aa6e86ad2f614719d386d8205ab6200a" exitCode=0
Aug 05 16:27:56.963258 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:56.962908    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v" event={"ID":"965d0aed-1c5b-4609-875b-6641e9556ddd","Type":"ContainerDied","Data":"2c9eb833f4dbf7fbfc2e0360184c7b98aa6e86ad2f614719d386d8205ab6200a"}
Aug 05 16:27:57.969663 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:57.969628    2546 generic.go:356] "Generic (PLEG): container finished" podID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerID="f09e027e6d1d1764f0b94fb6c3b89c1835d706b416bc18d9d0d5dcc65fce851f" exitCode=0
Aug 05 16:27:57.970108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:57.969679    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v" event={"ID":"965d0aed-1c5b-4609-875b-6641e9556ddd","Type":"ContainerDied","Data":"f09e027e6d1d1764f0b94fb6c3b89c1835d706b416bc18d9d0d5dcc65fce851f"}
Aug 05 16:27:59.098860 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.098837    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:27:59.274527 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.274421    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util\") pod \"965d0aed-1c5b-4609-875b-6641e9556ddd\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") "
Aug 05 16:27:59.274686 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.274534    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pph6f\" (UniqueName: \"kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f\") pod \"965d0aed-1c5b-4609-875b-6641e9556ddd\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") "
Aug 05 16:27:59.274686 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.274582    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle\") pod \"965d0aed-1c5b-4609-875b-6641e9556ddd\" (UID: \"965d0aed-1c5b-4609-875b-6641e9556ddd\") "
Aug 05 16:27:59.275292 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.275262    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle" (OuterVolumeSpecName: "bundle") pod "965d0aed-1c5b-4609-875b-6641e9556ddd" (UID: "965d0aed-1c5b-4609-875b-6641e9556ddd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:59.276600 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.276566    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f" (OuterVolumeSpecName: "kube-api-access-pph6f") pod "965d0aed-1c5b-4609-875b-6641e9556ddd" (UID: "965d0aed-1c5b-4609-875b-6641e9556ddd"). InnerVolumeSpecName "kube-api-access-pph6f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:27:59.280109 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.280084    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util" (OuterVolumeSpecName: "util") pod "965d0aed-1c5b-4609-875b-6641e9556ddd" (UID: "965d0aed-1c5b-4609-875b-6641e9556ddd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:27:59.375628 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.375599    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pph6f\" (UniqueName: \"kubernetes.io/projected/965d0aed-1c5b-4609-875b-6641e9556ddd-kube-api-access-pph6f\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:59.375628 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.375625    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:59.375628 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.375636    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/965d0aed-1c5b-4609-875b-6641e9556ddd-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:27:59.980098 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.980060    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v" event={"ID":"965d0aed-1c5b-4609-875b-6641e9556ddd","Type":"ContainerDied","Data":"9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b"}
Aug 05 16:27:59.980277 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.980113    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b118fa430315316632d7a1a6bb9724b0d4d9af645219553f5594babcad95e9b"
Aug 05 16:27:59.980277 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:27:59.980082    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afdpb9v"
Aug 05 16:28:06.362662 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362632    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"]
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362937    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="extract"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362948    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="extract"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362963    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="pull"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362968    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="pull"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362980    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="util"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.362985    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="util"
Aug 05 16:28:06.363036 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.363037    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="965d0aed-1c5b-4609-875b-6641e9556ddd" containerName="extract"
Aug 05 16:28:06.383042 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.383018    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.387230 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.387206    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"]
Aug 05 16:28:06.391103 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.391082    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Aug 05 16:28:06.391318 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.391298    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jcslj\""
Aug 05 16:28:06.391429 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.391368    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Aug 05 16:28:06.391877 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.391860    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Aug 05 16:28:06.395429 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.395412    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Aug 05 16:28:06.420280 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.420260    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.420406 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.420291    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.420406 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.420314    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g457v\" (UniqueName: \"kubernetes.io/projected/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-kube-api-access-g457v\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.420406 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.420375    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.420406 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.420402    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.520859 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.520820    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.520859 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.520863    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.521104 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.520892    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g457v\" (UniqueName: \"kubernetes.io/projected/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-kube-api-access-g457v\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.521104 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.520926    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.521104 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.520954    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.521365 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.521318    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-manifests\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.523401 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.523378    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-tmp\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.523521 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.523504    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.523639 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.523622    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-webhook-cert\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.534768 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.534741    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g457v\" (UniqueName: \"kubernetes.io/projected/7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d-kube-api-access-g457v\") pod \"opendatahub-operator-controller-manager-9778877d8-zfxtw\" (UID: \"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d\") " pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.694471 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.694378    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:06.867719 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:06.867631    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"]
Aug 05 16:28:06.870062 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:06.870029    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cbdbf95_adcf_4e5b_8bb5_ac34ba16405d.slice/crio-88c8fc0e5501d698407f70a7613c401e9daa2904af43b1bbf3904309efe9ba86 WatchSource:0}: Error finding container 88c8fc0e5501d698407f70a7613c401e9daa2904af43b1bbf3904309efe9ba86: Status 404 returned error can't find the container with id 88c8fc0e5501d698407f70a7613c401e9daa2904af43b1bbf3904309efe9ba86
Aug 05 16:28:07.011577 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:07.011504    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw" event={"ID":"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d","Type":"ContainerStarted","Data":"88c8fc0e5501d698407f70a7613c401e9daa2904af43b1bbf3904309efe9ba86"}
Aug 05 16:28:10.030367 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:10.030266    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw" event={"ID":"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d","Type":"ContainerStarted","Data":"e21cc54307a0b284d40cff28510e8544d7b27f412e7a02ff55a2ef18339eeeeb"}
Aug 05 16:28:11.035790 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:11.035754    2546 generic.go:356] "Generic (PLEG): container finished" podID="7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d" containerID="e21cc54307a0b284d40cff28510e8544d7b27f412e7a02ff55a2ef18339eeeeb" exitCode=0
Aug 05 16:28:11.036148 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:11.035823    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw" event={"ID":"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d","Type":"ContainerDied","Data":"e21cc54307a0b284d40cff28510e8544d7b27f412e7a02ff55a2ef18339eeeeb"}
Aug 05 16:28:12.042261 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:12.042230    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw" event={"ID":"7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d","Type":"ContainerStarted","Data":"1cb62831276bd678a1d21f74c8914011204bc6ef2c2b94a81fe99ad4d0e84755"}
Aug 05 16:28:12.042642 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:12.042349    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:12.070180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:12.070131    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw" podStartSLOduration=1.604501808 podStartE2EDuration="6.070111398s" totalImagesPullingTime="3.366876673s" totalInitContainerRuntime="1.098732917s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:12.069897388 +0000 UTC m=+406.331207985" watchObservedRunningTime="2026-08-05 16:28:12.070111398 +0000 UTC m=+406.331421999"
Aug 05 16:28:21.044977 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.044923    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-595c89bf85-njtrd" podUID="3860e8e1-57f2-4cff-a439-8931a108c897" containerName="console" containerID="cri-o://89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d" gracePeriod=15
Aug 05 16:28:21.284522 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.284499    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:28:21.358286 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358261    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358297    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358314    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gblqq\" (UniqueName: \"kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358362    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358385    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358447    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358757 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358492    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca\") pod \"3860e8e1-57f2-4cff-a439-8931a108c897\" (UID: \"3860e8e1-57f2-4cff-a439-8931a108c897\") "
Aug 05 16:28:21.358836 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358808    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:28:21.359192 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.358884    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config" (OuterVolumeSpecName: "console-config") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:28:21.359192 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.359125    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca" (OuterVolumeSpecName: "service-ca") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:28:21.359422 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.359398    2546 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-oauth-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.359478 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.359421    2546 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-console-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.359672 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.359648    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:28:21.360557 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.360530    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:28:21.360667 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.360629    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq" (OuterVolumeSpecName: "kube-api-access-gblqq") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "kube-api-access-gblqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:28:21.360732 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.360710    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3860e8e1-57f2-4cff-a439-8931a108c897" (UID: "3860e8e1-57f2-4cff-a439-8931a108c897"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 16:28:21.459936 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.459904    2546 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-serving-cert\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.459936 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.459928    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gblqq\" (UniqueName: \"kubernetes.io/projected/3860e8e1-57f2-4cff-a439-8931a108c897-kube-api-access-gblqq\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.460136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.459956    2546 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3860e8e1-57f2-4cff-a439-8931a108c897-console-oauth-config\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.460136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.459964    2546 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-trusted-ca-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:21.460136 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:21.459973    2546 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3860e8e1-57f2-4cff-a439-8931a108c897-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:28:22.086386 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.086348    2546 generic.go:356] "Generic (PLEG): container finished" podID="3860e8e1-57f2-4cff-a439-8931a108c897" containerID="89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d" exitCode=0
Aug 05 16:28:22.086783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.086400    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-595c89bf85-njtrd"
Aug 05 16:28:22.086783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.086429    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c89bf85-njtrd" event={"ID":"3860e8e1-57f2-4cff-a439-8931a108c897","Type":"ContainerDied","Data":"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"}
Aug 05 16:28:22.086783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.086503    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-595c89bf85-njtrd" event={"ID":"3860e8e1-57f2-4cff-a439-8931a108c897","Type":"ContainerDied","Data":"ac0103f6a1baf8ded6274f66a59cbc37e5973c30a7761f55ed3e8108a3acb697"}
Aug 05 16:28:22.086783 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.086523    2546 scope.go:117] "RemoveContainer" containerID="89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"
Aug 05 16:28:22.095088 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.095072    2546 scope.go:117] "RemoveContainer" containerID="89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"
Aug 05 16:28:22.095335 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:28:22.095302    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d\": container with ID starting with 89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d not found: ID does not exist" containerID="89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"
Aug 05 16:28:22.095392 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.095349    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d"} err="failed to get container status \"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d\": rpc error: code = NotFound desc = could not find container \"89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d\": container with ID starting with 89af1cd95f6c3e4af700904517809302eb629b084113263034534237f56cba9d not found: ID does not exist"
Aug 05 16:28:22.109155 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.109130    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:28:22.116528 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.116503    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-595c89bf85-njtrd"]
Aug 05 16:28:22.310397 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:22.310364    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3860e8e1-57f2-4cff-a439-8931a108c897" path="/var/lib/kubelet/pods/3860e8e1-57f2-4cff-a439-8931a108c897/volumes"
Aug 05 16:28:23.050157 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:23.050129    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9778877d8-zfxtw"
Aug 05 16:28:26.430000 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.429970    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l64rq"]
Aug 05 16:28:26.430419 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.430312    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3860e8e1-57f2-4cff-a439-8931a108c897" containerName="console"
Aug 05 16:28:26.430419 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.430336    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="3860e8e1-57f2-4cff-a439-8931a108c897" containerName="console"
Aug 05 16:28:26.430419 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.430420    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="3860e8e1-57f2-4cff-a439-8931a108c897" containerName="console"
Aug 05 16:28:26.435673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.435610    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:26.439274 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.439250    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-mws5q\""
Aug 05 16:28:26.439421 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.439400    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Aug 05 16:28:26.449200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.449178    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l64rq"]
Aug 05 16:28:26.502167 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.502138    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmnt8\" (UniqueName: \"kubernetes.io/projected/7513a5ab-c148-48e2-8026-d44974934808-kube-api-access-gmnt8\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:26.502167 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.502171    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:26.602613 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.602578    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmnt8\" (UniqueName: \"kubernetes.io/projected/7513a5ab-c148-48e2-8026-d44974934808-kube-api-access-gmnt8\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:26.602613 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.602617    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:26.602833 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:28:26.602785    2546 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Aug 05 16:28:26.602886 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:28:26.602871    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert podName:7513a5ab-c148-48e2-8026-d44974934808 nodeName:}" failed. No retries permitted until 2026-08-05 16:28:27.102848988 +0000 UTC m=+421.364159565 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert") pod "odh-model-controller-7998c67dc4-l64rq" (UID: "7513a5ab-c148-48e2-8026-d44974934808") : secret "odh-model-controller-webhook-cert" not found
Aug 05 16:28:26.621814 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:26.621790    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmnt8\" (UniqueName: \"kubernetes.io/projected/7513a5ab-c148-48e2-8026-d44974934808-kube-api-access-gmnt8\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:27.105673 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.105641    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:27.108063 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.108037    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7513a5ab-c148-48e2-8026-d44974934808-cert\") pod \"odh-model-controller-7998c67dc4-l64rq\" (UID: \"7513a5ab-c148-48e2-8026-d44974934808\") " pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:27.346316 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.346284    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:27.491159 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.491137    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-l64rq"]
Aug 05 16:28:27.492826 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:27.492796    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7513a5ab_c148_48e2_8026_d44974934808.slice/crio-42593f89669b526b384006666fa0acb6774befd031d07ad4bb62c43f7569f8b7 WatchSource:0}: Error finding container 42593f89669b526b384006666fa0acb6774befd031d07ad4bb62c43f7569f8b7: Status 404 returned error can't find the container with id 42593f89669b526b384006666fa0acb6774befd031d07ad4bb62c43f7569f8b7
Aug 05 16:28:27.530982 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.530957    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fkjrn"]
Aug 05 16:28:27.534021 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.534005    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.536164 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.536144    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-brv8b\""
Aug 05 16:28:27.538202 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.538186    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Aug 05 16:28:27.557042 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.557021    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fkjrn"]
Aug 05 16:28:27.610259 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.610230    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmb2z\" (UniqueName: \"kubernetes.io/projected/b6b67f64-253f-4404-862f-3afded59a9ea-kube-api-access-zmb2z\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.610447 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.610281    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b67f64-253f-4404-862f-3afded59a9ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.711695 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.711612    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b67f64-253f-4404-862f-3afded59a9ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.711831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.711748    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmb2z\" (UniqueName: \"kubernetes.io/projected/b6b67f64-253f-4404-862f-3afded59a9ea-kube-api-access-zmb2z\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.714108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.714089    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6b67f64-253f-4404-862f-3afded59a9ea-tls-certs\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.721284 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.721263    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmb2z\" (UniqueName: \"kubernetes.io/projected/b6b67f64-253f-4404-862f-3afded59a9ea-kube-api-access-zmb2z\") pod \"model-serving-api-54d89bd5fc-fkjrn\" (UID: \"b6b67f64-253f-4404-862f-3afded59a9ea\") " pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.844421 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.844386    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:27.981973 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:27.981950    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fkjrn"]
Aug 05 16:28:27.984026 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:27.983998    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6b67f64_253f_4404_862f_3afded59a9ea.slice/crio-25c5a6caf29d33aee09c2d632e5cd857d088de631e29984bd6934d3a5efd419c WatchSource:0}: Error finding container 25c5a6caf29d33aee09c2d632e5cd857d088de631e29984bd6934d3a5efd419c: Status 404 returned error can't find the container with id 25c5a6caf29d33aee09c2d632e5cd857d088de631e29984bd6934d3a5efd419c
Aug 05 16:28:28.117537 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:28.117498    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn" event={"ID":"b6b67f64-253f-4404-862f-3afded59a9ea","Type":"ContainerStarted","Data":"25c5a6caf29d33aee09c2d632e5cd857d088de631e29984bd6934d3a5efd419c"}
Aug 05 16:28:28.118636 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:28.118610    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq" event={"ID":"7513a5ab-c148-48e2-8026-d44974934808","Type":"ContainerStarted","Data":"42593f89669b526b384006666fa0acb6774befd031d07ad4bb62c43f7569f8b7"}
Aug 05 16:28:32.147242 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.147193    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn" event={"ID":"b6b67f64-253f-4404-862f-3afded59a9ea","Type":"ContainerStarted","Data":"ccbe7d9dcb53f13890a434478ffcbead86bc6af87789bff308b2cd5fb5fb3e01"}
Aug 05 16:28:32.147727 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.147305    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:32.149710 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.149679    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq" event={"ID":"7513a5ab-c148-48e2-8026-d44974934808","Type":"ContainerStarted","Data":"1f0183dcf62cc134af183f3829c301217ba46e7d8bf1e997e950b394b3567ab4"}
Aug 05 16:28:32.149858 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.149771    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:32.167070 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.167029    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn" podStartSLOduration=1.5553069819999998 podStartE2EDuration="5.167015811s" totalImagesPullingTime="3.611708829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:32.165342942 +0000 UTC m=+426.426653531" watchObservedRunningTime="2026-08-05 16:28:32.167015811 +0000 UTC m=+426.428326409"
Aug 05 16:28:32.181881 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:32.181840    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq" podStartSLOduration=2.116146441 podStartE2EDuration="6.181830853s" totalImagesPullingTime="4.065684412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:32.181739177 +0000 UTC m=+426.443049775" watchObservedRunningTime="2026-08-05 16:28:32.181830853 +0000 UTC m=+426.443141447"
Aug 05 16:28:36.843588 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.843551    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"]
Aug 05 16:28:36.845954 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.845932    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:36.850423 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.850401    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Aug 05 16:28:36.850517 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.850406    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Aug 05 16:28:36.854376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.854358    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Aug 05 16:28:36.866004 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.865981    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"]
Aug 05 16:28:36.867472 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.867452    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Aug 05 16:28:36.995954 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.995924    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06549988-9852-4703-afee-39e26cd336a9-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:36.996130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.995967    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnxsc\" (UniqueName: \"kubernetes.io/projected/06549988-9852-4703-afee-39e26cd336a9-kube-api-access-fnxsc\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:36.996130 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:36.995988    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06549988-9852-4703-afee-39e26cd336a9-tmp\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.096855 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.096753    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06549988-9852-4703-afee-39e26cd336a9-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.096855 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.096809    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnxsc\" (UniqueName: \"kubernetes.io/projected/06549988-9852-4703-afee-39e26cd336a9-kube-api-access-fnxsc\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.096855 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.096835    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06549988-9852-4703-afee-39e26cd336a9-tmp\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.099107 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.099082    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/06549988-9852-4703-afee-39e26cd336a9-tmp\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.099336 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.099303    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06549988-9852-4703-afee-39e26cd336a9-tls-certs\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.115121 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.115098    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnxsc\" (UniqueName: \"kubernetes.io/projected/06549988-9852-4703-afee-39e26cd336a9-kube-api-access-fnxsc\") pod \"kube-auth-proxy-8f6d6f675-6v9n6\" (UID: \"06549988-9852-4703-afee-39e26cd336a9\") " pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.156194 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.156164    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"
Aug 05 16:28:37.348391 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.348363    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6"]
Aug 05 16:28:37.350605 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:37.350576    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06549988_9852_4703_afee_39e26cd336a9.slice/crio-b17da70c87e4695f709c4910376b911df863b25a7bec30cee0b37d568ab23c52 WatchSource:0}: Error finding container b17da70c87e4695f709c4910376b911df863b25a7bec30cee0b37d568ab23c52: Status 404 returned error can't find the container with id b17da70c87e4695f709c4910376b911df863b25a7bec30cee0b37d568ab23c52
Aug 05 16:28:37.441376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.441340    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"]
Aug 05 16:28:37.445190 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.445168    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.448650 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.448623    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-g5nrt\""
Aug 05 16:28:37.448976 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.448959    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Aug 05 16:28:37.472807 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.472776    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"]
Aug 05 16:28:37.479355 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.479306    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"]
Aug 05 16:28:37.481948 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.481925    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.484306 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.484282    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-sbm8p\""
Aug 05 16:28:37.484424 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.484335    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Aug 05 16:28:37.496200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.496171    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"]
Aug 05 16:28:37.601075 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.600990    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d61e39-229b-40b9-9e7e-bbb43570b45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.601075 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.601055    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvn75\" (UniqueName: \"kubernetes.io/projected/96c67940-d5aa-4690-8391-9a5c08d301fd-kube-api-access-lvn75\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.601477 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.601125    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qsqzx\" (UniqueName: \"kubernetes.io/projected/b8d61e39-229b-40b9-9e7e-bbb43570b45f-kube-api-access-qsqzx\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.601477 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.601153    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.702591 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.702554    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvn75\" (UniqueName: \"kubernetes.io/projected/96c67940-d5aa-4690-8391-9a5c08d301fd-kube-api-access-lvn75\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.702770 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.702621    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qsqzx\" (UniqueName: \"kubernetes.io/projected/b8d61e39-229b-40b9-9e7e-bbb43570b45f-kube-api-access-qsqzx\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.702770 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.702707    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.702770 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.702760    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d61e39-229b-40b9-9e7e-bbb43570b45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.702971 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:28:37.702856    2546 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Aug 05 16:28:37.702971 ip-10-0-134-153 kubenswrapper[2546]: E0805 16:28:37.702921    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert podName:96c67940-d5aa-4690-8391-9a5c08d301fd nodeName:}" failed. No retries permitted until 2026-08-05 16:28:38.202899453 +0000 UTC m=+432.464210035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert") pod "llmisvc-controller-manager-777c6bd7d5-79cf6" (UID: "96c67940-d5aa-4690-8391-9a5c08d301fd") : secret "llmisvc-webhook-server-cert" not found
Aug 05 16:28:37.705280 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.705257    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8d61e39-229b-40b9-9e7e-bbb43570b45f-cert\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.721940 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.721914    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvn75\" (UniqueName: \"kubernetes.io/projected/96c67940-d5aa-4690-8391-9a5c08d301fd-kube-api-access-lvn75\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:37.722238 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.722221    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qsqzx\" (UniqueName: \"kubernetes.io/projected/b8d61e39-229b-40b9-9e7e-bbb43570b45f-kube-api-access-qsqzx\") pod \"kserve-controller-manager-d6f4b65b8-w6jqw\" (UID: \"b8d61e39-229b-40b9-9e7e-bbb43570b45f\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.755231 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.755209    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:37.905299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:37.905275    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"]
Aug 05 16:28:37.907020 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:37.906995    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8d61e39_229b_40b9_9e7e_bbb43570b45f.slice/crio-9d22ff38b2b6a002721bf91864608556fa5913b1f2ad79233ee8c6e1c56780e9 WatchSource:0}: Error finding container 9d22ff38b2b6a002721bf91864608556fa5913b1f2ad79233ee8c6e1c56780e9: Status 404 returned error can't find the container with id 9d22ff38b2b6a002721bf91864608556fa5913b1f2ad79233ee8c6e1c56780e9
Aug 05 16:28:38.182529 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.182449    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw" event={"ID":"b8d61e39-229b-40b9-9e7e-bbb43570b45f","Type":"ContainerStarted","Data":"9d22ff38b2b6a002721bf91864608556fa5913b1f2ad79233ee8c6e1c56780e9"}
Aug 05 16:28:38.183875 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.183842    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6" event={"ID":"06549988-9852-4703-afee-39e26cd336a9","Type":"ContainerStarted","Data":"b17da70c87e4695f709c4910376b911df863b25a7bec30cee0b37d568ab23c52"}
Aug 05 16:28:38.207903 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.207873    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:38.210754 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.210728    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/96c67940-d5aa-4690-8391-9a5c08d301fd-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-79cf6\" (UID: \"96c67940-d5aa-4690-8391-9a5c08d301fd\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:38.392164 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.392124    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:38.558947 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:38.558916    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"]
Aug 05 16:28:38.562830 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:38.562788    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod96c67940_d5aa_4690_8391_9a5c08d301fd.slice/crio-c73120c3fe2dae2f4917a09db1e909c33b6346a0c76027f5c2da0d29eb18bac1 WatchSource:0}: Error finding container c73120c3fe2dae2f4917a09db1e909c33b6346a0c76027f5c2da0d29eb18bac1: Status 404 returned error can't find the container with id c73120c3fe2dae2f4917a09db1e909c33b6346a0c76027f5c2da0d29eb18bac1
Aug 05 16:28:39.110254 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.110224    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"]
Aug 05 16:28:39.114554 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.114532    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.119265 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.119241    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Aug 05 16:28:39.119398 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.119264    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-dw2s4\""
Aug 05 16:28:39.120124 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.119721    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Aug 05 16:28:39.120124 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.119878    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Aug 05 16:28:39.120124 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.119994    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Aug 05 16:28:39.136160 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.136127    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"]
Aug 05 16:28:39.191361 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.191303    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6" event={"ID":"96c67940-d5aa-4690-8391-9a5c08d301fd","Type":"ContainerStarted","Data":"c73120c3fe2dae2f4917a09db1e909c33b6346a0c76027f5c2da0d29eb18bac1"}
Aug 05 16:28:39.217541 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217490    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217724 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217564    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217724 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217601    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3528698f-27a0-48d1-8663-7466bfdc61b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217724 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217628    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217939 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217733    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmkms\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-kube-api-access-bmkms\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217939 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217784    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.217939 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.217837    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318630 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318590    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318630 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318634    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318826 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318664    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3528698f-27a0-48d1-8663-7466bfdc61b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318826 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318692    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318826 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318737    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmkms\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-kube-api-access-bmkms\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.318826 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318774    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.319001 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.318963    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.319270 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.319249    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.321024 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.320997    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3528698f-27a0-48d1-8663-7466bfdc61b0-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.321180 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.321163    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.321223 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.321183    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.321261 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.321239    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.327795 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.327767    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.328422 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.328399    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmkms\" (UniqueName: \"kubernetes.io/projected/3528698f-27a0-48d1-8663-7466bfdc61b0-kube-api-access-bmkms\") pod \"istiod-openshift-gateway-5677ccb49b-s55pd\" (UID: \"3528698f-27a0-48d1-8663-7466bfdc61b0\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.427525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.427431    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:39.592366 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:39.592319    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"]
Aug 05 16:28:39.595060 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:28:39.595036    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3528698f_27a0_48d1_8663_7466bfdc61b0.slice/crio-60fc5ae2b4e9da80667f44218c15aaf8e6a4fec8067462c2c2640a2ff7f13ac0 WatchSource:0}: Error finding container 60fc5ae2b4e9da80667f44218c15aaf8e6a4fec8067462c2c2640a2ff7f13ac0: Status 404 returned error can't find the container with id 60fc5ae2b4e9da80667f44218c15aaf8e6a4fec8067462c2c2640a2ff7f13ac0
Aug 05 16:28:40.197789 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:40.197758    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd" event={"ID":"3528698f-27a0-48d1-8663-7466bfdc61b0","Type":"ContainerStarted","Data":"60fc5ae2b4e9da80667f44218c15aaf8e6a4fec8067462c2c2640a2ff7f13ac0"}
Aug 05 16:28:43.156824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.156787    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-l64rq"
Aug 05 16:28:43.158901 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.158873    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fkjrn"
Aug 05 16:28:43.220363 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.220303    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw" event={"ID":"b8d61e39-229b-40b9-9e7e-bbb43570b45f","Type":"ContainerStarted","Data":"a4abf33380dddbbce1805799d61b93ab5b61b030258729ee26443006adbdf3ea"}
Aug 05 16:28:43.220538 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.220419    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:28:43.222441 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.222402    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6" event={"ID":"06549988-9852-4703-afee-39e26cd336a9","Type":"ContainerStarted","Data":"76380cf7deaa9099b36e34632c92c63623e620886a76ba737ebf76c23e09b175"}
Aug 05 16:28:43.224263 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.224205    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6" event={"ID":"96c67940-d5aa-4690-8391-9a5c08d301fd","Type":"ContainerStarted","Data":"5a09fb01cb209c2fb76c1c4ed4644b7e47a24c0f1fd9d210116e22f6a54671d8"}
Aug 05 16:28:43.224524 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.224459    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:28:43.242791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.242733    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw" podStartSLOduration=2.518174631 podStartE2EDuration="6.242712137s" totalImagesPullingTime="3.724537506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:43.240438277 +0000 UTC m=+437.501748877" watchObservedRunningTime="2026-08-05 16:28:43.242712137 +0000 UTC m=+437.504022736"
Aug 05 16:28:43.260524 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.260469    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6" podStartSLOduration=2.181076635 podStartE2EDuration="6.26045204s" totalImagesPullingTime="4.079375405s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:43.258765495 +0000 UTC m=+437.520076096" watchObservedRunningTime="2026-08-05 16:28:43.26045204 +0000 UTC m=+437.521762641"
Aug 05 16:28:43.282376 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.282297    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-8f6d6f675-6v9n6" podStartSLOduration=3.043638053 podStartE2EDuration="7.282275212s" totalImagesPullingTime="4.238637159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:43.280180454 +0000 UTC m=+437.541491053" watchObservedRunningTime="2026-08-05 16:28:43.282275212 +0000 UTC m=+437.543585811"
Aug 05 16:28:43.809799 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.809764    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:28:43.809885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:43.809832    2546 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Aug 05 16:28:44.231818 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:44.231782    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd" event={"ID":"3528698f-27a0-48d1-8663-7466bfdc61b0","Type":"ContainerStarted","Data":"1f1acb1825134227650b3ab74094a2ade9bc500181f5497c227964792bf0d68f"}
Aug 05 16:28:44.232438 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:44.232419    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:44.233896 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:44.233864    2546 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-s55pd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Aug 05 16:28:44.233996 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:44.233933    2546 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd" podUID="3528698f-27a0-48d1-8663-7466bfdc61b0" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Aug 05 16:28:45.245073 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:45.245040    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd"
Aug 05 16:28:45.273856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:28:45.273791    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s55pd" podStartSLOduration=2.061385223 podStartE2EDuration="6.273771321s" totalImagesPullingTime="4.212386098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:28:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:28:44.262452298 +0000 UTC m=+438.523762897" watchObservedRunningTime="2026-08-05 16:28:45.273771321 +0000 UTC m=+439.535081920"
Aug 05 16:29:14.234374 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:14.234342    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-79cf6"
Aug 05 16:29:14.237379 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:14.237360    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w6jqw"
Aug 05 16:29:30.747375 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.747341    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"]
Aug 05 16:29:30.752821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.752803    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.755243 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.755222    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Aug 05 16:29:30.755756 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.755734    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-q7jrs\""
Aug 05 16:29:30.755756 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.755733    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Aug 05 16:29:30.758831 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.758807    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"]
Aug 05 16:29:30.852175 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.852143    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"]
Aug 05 16:29:30.854688 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.854671    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:30.855950 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.855924    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdhmn\" (UniqueName: \"kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.856021 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.855990    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.856059 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.856031    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.868287 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.868266    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"]
Aug 05 16:29:30.956620 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956582    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:30.956620 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956619    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgkdd\" (UniqueName: \"kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:30.956856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956663    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdhmn\" (UniqueName: \"kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.956856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956697    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.956856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956718    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.956856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.956740    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:30.957059 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.957040    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.957141 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.957120    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.964583 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.964559    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"]
Aug 05 16:29:30.967347 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.967304    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:30.970108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.970083    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdhmn\" (UniqueName: \"kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:30.979579 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:30.979557    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"]
Aug 05 16:29:31.056636 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.056564    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"]
Aug 05 16:29:31.057732 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057710    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.057841 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057764    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.057841 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057830    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.057958 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057897    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.057958 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057923    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgkdd\" (UniqueName: \"kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.057958 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.057956    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnckc\" (UniqueName: \"kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.058149 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.058130    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.058205 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.058158    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.059438 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.059424    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.062774 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.062759    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:31.066933 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.066915    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgkdd\" (UniqueName: \"kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.070830 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.070806    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"]
Aug 05 16:29:31.158961 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.158913    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.159123 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.158992    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.159123 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159040    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.159123 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159101    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnckc\" (UniqueName: \"kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.159302 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159137    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.159302 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159174    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2cv\" (UniqueName: \"kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.159445 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159420    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.159525 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.159428    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.163799 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.163770    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:31.170091 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.170062    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnckc\" (UniqueName: \"kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.202984 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.202954    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"]
Aug 05 16:29:31.205965 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:29:31.205937    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7b98d8e_3620_415c_be45_f2c2938e597d.slice/crio-f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1 WatchSource:0}: Error finding container f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1: Status 404 returned error can't find the container with id f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1
Aug 05 16:29:31.260660 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.260629    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.260792 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.260685    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2cv\" (UniqueName: \"kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.260792 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.260783    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.261104 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.261075    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.261104 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.261095    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.269435 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.269414    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2cv\" (UniqueName: \"kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.285532 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.285508    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:31.305883 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.305856    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"]
Aug 05 16:29:31.307605 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:29:31.307554    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d979edc_0d87_488d_8fe1_acc9f82779f8.slice/crio-18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1 WatchSource:0}: Error finding container 18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1: Status 404 returned error can't find the container with id 18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1
Aug 05 16:29:31.386006 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.385980    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:31.430430 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.430402    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"]
Aug 05 16:29:31.431870 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:29:31.431842    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e6d197e_1567_4004_ba92_a61ef2c52000.slice/crio-bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134 WatchSource:0}: Error finding container bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134: Status 404 returned error can't find the container with id bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134
Aug 05 16:29:31.459856 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.459805    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg" event={"ID":"4e6d197e-1567-4004-ba92-a61ef2c52000","Type":"ContainerStarted","Data":"bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134"}
Aug 05 16:29:31.461431 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.461320    2546 generic.go:356] "Generic (PLEG): container finished" podID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerID="b3da25d1e291bb624999d40f7ac91ae075e0614fc31ebcfad989d4083cf65aa1" exitCode=0
Aug 05 16:29:31.461546 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.461443    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff" event={"ID":"f7b98d8e-3620-415c-be45-f2c2938e597d","Type":"ContainerDied","Data":"b3da25d1e291bb624999d40f7ac91ae075e0614fc31ebcfad989d4083cf65aa1"}
Aug 05 16:29:31.461546 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.461489    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff" event={"ID":"f7b98d8e-3620-415c-be45-f2c2938e597d","Type":"ContainerStarted","Data":"f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1"}
Aug 05 16:29:31.463033 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.463008    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerStarted","Data":"549d16748fa6392a5d3f6d3ddb5c5d747ce2fcb3ed24316e99cbe048c2751a7e"}
Aug 05 16:29:31.463126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.463047    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerStarted","Data":"18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1"}
Aug 05 16:29:31.531957 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:31.531931    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"]
Aug 05 16:29:31.534044 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:29:31.534016    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd2837b_c610_45e8_9eea_fee45a3cec62.slice/crio-23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9 WatchSource:0}: Error finding container 23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9: Status 404 returned error can't find the container with id 23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9
Aug 05 16:29:32.468766 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.468732    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerID="9d72142e50b58fa95ad8c52714a545fb5e11e2abb427ced5c5f885b11b5d7f93" exitCode=0
Aug 05 16:29:32.469187 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.468801    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg" event={"ID":"4e6d197e-1567-4004-ba92-a61ef2c52000","Type":"ContainerDied","Data":"9d72142e50b58fa95ad8c52714a545fb5e11e2abb427ced5c5f885b11b5d7f93"}
Aug 05 16:29:32.470792 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.470764    2546 generic.go:356] "Generic (PLEG): container finished" podID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerID="c585165ee6b038cafd0914dfbce9e93b1de558988ea077f9ed2c52d5fff22238" exitCode=0
Aug 05 16:29:32.470881 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.470799    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff" event={"ID":"f7b98d8e-3620-415c-be45-f2c2938e597d","Type":"ContainerDied","Data":"c585165ee6b038cafd0914dfbce9e93b1de558988ea077f9ed2c52d5fff22238"}
Aug 05 16:29:32.472623 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.472601    2546 generic.go:356] "Generic (PLEG): container finished" podID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerID="549d16748fa6392a5d3f6d3ddb5c5d747ce2fcb3ed24316e99cbe048c2751a7e" exitCode=0
Aug 05 16:29:32.472709 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.472665    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerDied","Data":"549d16748fa6392a5d3f6d3ddb5c5d747ce2fcb3ed24316e99cbe048c2751a7e"}
Aug 05 16:29:32.474029 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.474009    2546 generic.go:356] "Generic (PLEG): container finished" podID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerID="1be4d0a5c0f383e1491c3e0da175b5678466ebbc397c3c2f0d429f865296cd29" exitCode=0
Aug 05 16:29:32.474101 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.474035    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv" event={"ID":"9bd2837b-c610-45e8-9eea-fee45a3cec62","Type":"ContainerDied","Data":"1be4d0a5c0f383e1491c3e0da175b5678466ebbc397c3c2f0d429f865296cd29"}
Aug 05 16:29:32.474101 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:32.474068    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv" event={"ID":"9bd2837b-c610-45e8-9eea-fee45a3cec62","Type":"ContainerStarted","Data":"23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9"}
Aug 05 16:29:33.480568 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.480473    2546 generic.go:356] "Generic (PLEG): container finished" podID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerID="bc54f9abbbb2b3338386441bdd1b9f11178243978993030643df86b3bcf9d774" exitCode=0
Aug 05 16:29:33.481012 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.480560    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv" event={"ID":"9bd2837b-c610-45e8-9eea-fee45a3cec62","Type":"ContainerDied","Data":"bc54f9abbbb2b3338386441bdd1b9f11178243978993030643df86b3bcf9d774"}
Aug 05 16:29:33.482597 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.482573    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerID="2e365cdb0c89b7f67d64c50f1ef26770057292a4bc9fe9abb8f254c0da57072a" exitCode=0
Aug 05 16:29:33.482683 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.482643    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg" event={"ID":"4e6d197e-1567-4004-ba92-a61ef2c52000","Type":"ContainerDied","Data":"2e365cdb0c89b7f67d64c50f1ef26770057292a4bc9fe9abb8f254c0da57072a"}
Aug 05 16:29:33.484984 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.484965    2546 generic.go:356] "Generic (PLEG): container finished" podID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerID="4da67023b241969aea8a0fcbf35697824216821312b56d58bb9ad5dcecf16364" exitCode=0
Aug 05 16:29:33.485065 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:33.485008    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff" event={"ID":"f7b98d8e-3620-415c-be45-f2c2938e597d","Type":"ContainerDied","Data":"4da67023b241969aea8a0fcbf35697824216821312b56d58bb9ad5dcecf16364"}
Aug 05 16:29:34.492495 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.492418    2546 generic.go:356] "Generic (PLEG): container finished" podID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerID="2b7fa870d09ccbcee131bd2a7e89e8124a762d1b7f8cd2255afaab480c4a23db" exitCode=0
Aug 05 16:29:34.492885 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.492499    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg" event={"ID":"4e6d197e-1567-4004-ba92-a61ef2c52000","Type":"ContainerDied","Data":"2b7fa870d09ccbcee131bd2a7e89e8124a762d1b7f8cd2255afaab480c4a23db"}
Aug 05 16:29:34.494653 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.494629    2546 generic.go:356] "Generic (PLEG): container finished" podID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerID="d51cf3eaadbcafe0ee0190e4f892e86d2f248c5e4acdb1b86142344d5919ea30" exitCode=0
Aug 05 16:29:34.494743 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.494708    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv" event={"ID":"9bd2837b-c610-45e8-9eea-fee45a3cec62","Type":"ContainerDied","Data":"d51cf3eaadbcafe0ee0190e4f892e86d2f248c5e4acdb1b86142344d5919ea30"}
Aug 05 16:29:34.626518 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.626487    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:34.792661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.792584    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle\") pod \"f7b98d8e-3620-415c-be45-f2c2938e597d\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") "
Aug 05 16:29:34.792661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.792627    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdhmn\" (UniqueName: \"kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn\") pod \"f7b98d8e-3620-415c-be45-f2c2938e597d\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") "
Aug 05 16:29:34.792661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.792658    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util\") pod \"f7b98d8e-3620-415c-be45-f2c2938e597d\" (UID: \"f7b98d8e-3620-415c-be45-f2c2938e597d\") "
Aug 05 16:29:34.793107 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.793078    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle" (OuterVolumeSpecName: "bundle") pod "f7b98d8e-3620-415c-be45-f2c2938e597d" (UID: "f7b98d8e-3620-415c-be45-f2c2938e597d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:34.794734 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.794710    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn" (OuterVolumeSpecName: "kube-api-access-wdhmn") pod "f7b98d8e-3620-415c-be45-f2c2938e597d" (UID: "f7b98d8e-3620-415c-be45-f2c2938e597d"). InnerVolumeSpecName "kube-api-access-wdhmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:29:34.798085 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.798060    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util" (OuterVolumeSpecName: "util") pod "f7b98d8e-3620-415c-be45-f2c2938e597d" (UID: "f7b98d8e-3620-415c-be45-f2c2938e597d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:34.894213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.894184    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:34.894213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.894210    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdhmn\" (UniqueName: \"kubernetes.io/projected/f7b98d8e-3620-415c-be45-f2c2938e597d-kube-api-access-wdhmn\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:34.894213 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:34.894219    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f7b98d8e-3620-415c-be45-f2c2938e597d-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.502803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.502767    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff" event={"ID":"f7b98d8e-3620-415c-be45-f2c2938e597d","Type":"ContainerDied","Data":"f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1"}
Aug 05 16:29:35.503251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.502811    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbpdgff"
Aug 05 16:29:35.503251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.502816    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f90694bf8abf60e11893516e34e504ee103a9d168d86d4fe38e5db611ed5ada1"
Aug 05 16:29:35.632490 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.632465    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:35.659802 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.659783    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:35.801821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801733    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ls2cv\" (UniqueName: \"kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv\") pod \"9bd2837b-c610-45e8-9eea-fee45a3cec62\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") "
Aug 05 16:29:35.801821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801775    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util\") pod \"4e6d197e-1567-4004-ba92-a61ef2c52000\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") "
Aug 05 16:29:35.801821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801806    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util\") pod \"9bd2837b-c610-45e8-9eea-fee45a3cec62\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") "
Aug 05 16:29:35.802196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801872    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle\") pod \"9bd2837b-c610-45e8-9eea-fee45a3cec62\" (UID: \"9bd2837b-c610-45e8-9eea-fee45a3cec62\") "
Aug 05 16:29:35.802196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801899    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle\") pod \"4e6d197e-1567-4004-ba92-a61ef2c52000\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") "
Aug 05 16:29:35.802196 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.801949    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnckc\" (UniqueName: \"kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc\") pod \"4e6d197e-1567-4004-ba92-a61ef2c52000\" (UID: \"4e6d197e-1567-4004-ba92-a61ef2c52000\") "
Aug 05 16:29:35.802436 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.802371    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle" (OuterVolumeSpecName: "bundle") pod "9bd2837b-c610-45e8-9eea-fee45a3cec62" (UID: "9bd2837b-c610-45e8-9eea-fee45a3cec62"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:35.802655 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.802612    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle" (OuterVolumeSpecName: "bundle") pod "4e6d197e-1567-4004-ba92-a61ef2c52000" (UID: "4e6d197e-1567-4004-ba92-a61ef2c52000"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:35.804057 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.804030    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv" (OuterVolumeSpecName: "kube-api-access-ls2cv") pod "9bd2837b-c610-45e8-9eea-fee45a3cec62" (UID: "9bd2837b-c610-45e8-9eea-fee45a3cec62"). InnerVolumeSpecName "kube-api-access-ls2cv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:29:35.804151 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.804087    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc" (OuterVolumeSpecName: "kube-api-access-lnckc") pod "4e6d197e-1567-4004-ba92-a61ef2c52000" (UID: "4e6d197e-1567-4004-ba92-a61ef2c52000"). InnerVolumeSpecName "kube-api-access-lnckc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:29:35.807565 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.807532    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util" (OuterVolumeSpecName: "util") pod "4e6d197e-1567-4004-ba92-a61ef2c52000" (UID: "4e6d197e-1567-4004-ba92-a61ef2c52000"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:35.810518 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.810497    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util" (OuterVolumeSpecName: "util") pod "9bd2837b-c610-45e8-9eea-fee45a3cec62" (UID: "9bd2837b-c610-45e8-9eea-fee45a3cec62"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:35.903211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903169    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.903211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903207    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.903211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903218    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnckc\" (UniqueName: \"kubernetes.io/projected/4e6d197e-1567-4004-ba92-a61ef2c52000-kube-api-access-lnckc\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.903454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903229    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ls2cv\" (UniqueName: \"kubernetes.io/projected/9bd2837b-c610-45e8-9eea-fee45a3cec62-kube-api-access-ls2cv\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.903454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903237    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4e6d197e-1567-4004-ba92-a61ef2c52000-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:35.903454 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:35.903245    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bd2837b-c610-45e8-9eea-fee45a3cec62-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:36.509364 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.509318    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg"
Aug 05 16:29:36.509364 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.509360    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c88kkg" event={"ID":"4e6d197e-1567-4004-ba92-a61ef2c52000","Type":"ContainerDied","Data":"bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134"}
Aug 05 16:29:36.509853 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.509408    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc6a1946b0ad4d9187e2eff30869eb35e86b362759a0b774c2c511d023d9a134"
Aug 05 16:29:36.511415 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.511389    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv" event={"ID":"9bd2837b-c610-45e8-9eea-fee45a3cec62","Type":"ContainerDied","Data":"23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9"}
Aug 05 16:29:36.511555 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.511432    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="23abe27662fff1d8e9bc6d958200e8b18916e2a1c3619b34f665164f9014fce9"
Aug 05 16:29:36.511555 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:36.511444    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0drrcv"
Aug 05 16:29:54.603771 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:54.603729    2546 generic.go:356] "Generic (PLEG): container finished" podID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerID="cfbfe0fe5a44b7bc30963f3b1e7237137d3a89496883ba2a9a042f35e19cab8b" exitCode=0
Aug 05 16:29:54.604192 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:54.603820    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerDied","Data":"cfbfe0fe5a44b7bc30963f3b1e7237137d3a89496883ba2a9a042f35e19cab8b"}
Aug 05 16:29:55.611393 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:55.611355    2546 generic.go:356] "Generic (PLEG): container finished" podID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerID="b220e47b89473f9b114940f8244026bc30b39d4c99ad000890a5616ebdba95b6" exitCode=0
Aug 05 16:29:55.611779 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:55.611417    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerDied","Data":"b220e47b89473f9b114940f8244026bc30b39d4c99ad000890a5616ebdba95b6"}
Aug 05 16:29:56.744497 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.744471    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:56.770251 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.770225    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util\") pod \"7d979edc-0d87-488d-8fe1-acc9f82779f8\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") "
Aug 05 16:29:56.770423 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.770267    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgkdd\" (UniqueName: \"kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd\") pod \"7d979edc-0d87-488d-8fe1-acc9f82779f8\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") "
Aug 05 16:29:56.770423 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.770384    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle\") pod \"7d979edc-0d87-488d-8fe1-acc9f82779f8\" (UID: \"7d979edc-0d87-488d-8fe1-acc9f82779f8\") "
Aug 05 16:29:56.771248 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.771207    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle" (OuterVolumeSpecName: "bundle") pod "7d979edc-0d87-488d-8fe1-acc9f82779f8" (UID: "7d979edc-0d87-488d-8fe1-acc9f82779f8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:56.772760 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.772737    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd" (OuterVolumeSpecName: "kube-api-access-rgkdd") pod "7d979edc-0d87-488d-8fe1-acc9f82779f8" (UID: "7d979edc-0d87-488d-8fe1-acc9f82779f8"). InnerVolumeSpecName "kube-api-access-rgkdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 16:29:56.777160 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.777133    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util" (OuterVolumeSpecName: "util") pod "7d979edc-0d87-488d-8fe1-acc9f82779f8" (UID: "7d979edc-0d87-488d-8fe1-acc9f82779f8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 16:29:56.871924 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.871822    2546 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-bundle\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:56.871924 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.871864    2546 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7d979edc-0d87-488d-8fe1-acc9f82779f8-util\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:56.871924 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:56.871873    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgkdd\" (UniqueName: \"kubernetes.io/projected/7d979edc-0d87-488d-8fe1-acc9f82779f8-kube-api-access-rgkdd\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:29:57.622964 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:57.622934    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch"
Aug 05 16:29:57.623164 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:57.622931    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053ppxch" event={"ID":"7d979edc-0d87-488d-8fe1-acc9f82779f8","Type":"ContainerDied","Data":"18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1"}
Aug 05 16:29:57.623164 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:29:57.623073    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18d66643ef4d5e1d093b8bcb77ca100211bc1e50234a8e82f0541c2f701eb9f1"
Aug 05 16:30:07.833958 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.833922    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"]
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834261    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834271    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834287    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834293    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834298    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834303    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834310    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834316    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834339    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834346    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834356    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834364    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834374    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834379    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834391    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834396    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834404    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834409    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="util"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834414    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834419    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834425    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834431    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="extract"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834437    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="pull"
Aug 05 16:30:07.834440 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834441    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="pull"
Aug 05 16:30:07.835129 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834495    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e6d197e-1567-4004-ba92-a61ef2c52000" containerName="extract"
Aug 05 16:30:07.835129 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834504    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d979edc-0d87-488d-8fe1-acc9f82779f8" containerName="extract"
Aug 05 16:30:07.835129 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834510    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd2837b-c610-45e8-9eea-fee45a3cec62" containerName="extract"
Aug 05 16:30:07.835129 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.834515    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7b98d8e-3620-415c-be45-f2c2938e597d" containerName="extract"
Aug 05 16:30:07.837478 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.837462    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:07.841221 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.841201    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Aug 05 16:30:07.841385 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.841363    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-sjjxm\""
Aug 05 16:30:07.841620 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.841605    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Aug 05 16:30:07.842200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.842187    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Aug 05 16:30:07.858680 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.858653    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"]
Aug 05 16:30:07.869401 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.869378    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tp85\" (UniqueName: \"kubernetes.io/projected/9313738c-2854-4bfc-a425-bbdaf8557822-kube-api-access-6tp85\") pod \"dns-operator-controller-manager-5985564776-ql82n\" (UID: \"9313738c-2854-4bfc-a425-bbdaf8557822\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:07.969996 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.969960    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tp85\" (UniqueName: \"kubernetes.io/projected/9313738c-2854-4bfc-a425-bbdaf8557822-kube-api-access-6tp85\") pod \"dns-operator-controller-manager-5985564776-ql82n\" (UID: \"9313738c-2854-4bfc-a425-bbdaf8557822\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:07.988983 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:07.988954    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tp85\" (UniqueName: \"kubernetes.io/projected/9313738c-2854-4bfc-a425-bbdaf8557822-kube-api-access-6tp85\") pod \"dns-operator-controller-manager-5985564776-ql82n\" (UID: \"9313738c-2854-4bfc-a425-bbdaf8557822\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:08.149060 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:08.148969    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:08.288486 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:08.288461    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"]
Aug 05 16:30:08.289871 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:30:08.289849    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9313738c_2854_4bfc_a425_bbdaf8557822.slice/crio-eced3f0da95aca52e621764ef6e4bebff0364415d645d0df3bdacaa82ef1206b WatchSource:0}: Error finding container eced3f0da95aca52e621764ef6e4bebff0364415d645d0df3bdacaa82ef1206b: Status 404 returned error can't find the container with id eced3f0da95aca52e621764ef6e4bebff0364415d645d0df3bdacaa82ef1206b
Aug 05 16:30:08.678498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:08.678463    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n" event={"ID":"9313738c-2854-4bfc-a425-bbdaf8557822","Type":"ContainerStarted","Data":"eced3f0da95aca52e621764ef6e4bebff0364415d645d0df3bdacaa82ef1206b"}
Aug 05 16:30:10.735426 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.735386    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-p9jz7"]
Aug 05 16:30:10.743409 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.743386    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:10.746155 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.746133    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-df8rb\""
Aug 05 16:30:10.753590 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.753566    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-p9jz7"]
Aug 05 16:30:10.799645 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.799607    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj7w7\" (UniqueName: \"kubernetes.io/projected/32035862-e374-419f-ba1f-06fa7dfe3d94-kube-api-access-kj7w7\") pod \"authorino-operator-68d88948d8-p9jz7\" (UID: \"32035862-e374-419f-ba1f-06fa7dfe3d94\") " pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:10.900396 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.900358    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj7w7\" (UniqueName: \"kubernetes.io/projected/32035862-e374-419f-ba1f-06fa7dfe3d94-kube-api-access-kj7w7\") pod \"authorino-operator-68d88948d8-p9jz7\" (UID: \"32035862-e374-419f-ba1f-06fa7dfe3d94\") " pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:10.914961 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:10.914892    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj7w7\" (UniqueName: \"kubernetes.io/projected/32035862-e374-419f-ba1f-06fa7dfe3d94-kube-api-access-kj7w7\") pod \"authorino-operator-68d88948d8-p9jz7\" (UID: \"32035862-e374-419f-ba1f-06fa7dfe3d94\") " pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:11.056914 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:11.056838    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:11.500121 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:11.500093    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-p9jz7"]
Aug 05 16:30:11.502378 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:30:11.502349    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32035862_e374_419f_ba1f_06fa7dfe3d94.slice/crio-10a34c769b53ebeba4a31d8f88cd2a32a041390d8a20f8c3fa34c4daa28a7a10 WatchSource:0}: Error finding container 10a34c769b53ebeba4a31d8f88cd2a32a041390d8a20f8c3fa34c4daa28a7a10: Status 404 returned error can't find the container with id 10a34c769b53ebeba4a31d8f88cd2a32a041390d8a20f8c3fa34c4daa28a7a10
Aug 05 16:30:11.698675 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:11.698580    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n" event={"ID":"9313738c-2854-4bfc-a425-bbdaf8557822","Type":"ContainerStarted","Data":"634bd1f07b4ff011cceb97020243f9cdc7d40d053e8f8d755837359a9f010b54"}
Aug 05 16:30:11.698675 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:11.698646    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:11.699899 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:11.699875    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7" event={"ID":"32035862-e374-419f-ba1f-06fa7dfe3d94","Type":"ContainerStarted","Data":"10a34c769b53ebeba4a31d8f88cd2a32a041390d8a20f8c3fa34c4daa28a7a10"}
Aug 05 16:30:14.718429 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:14.718392    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7" event={"ID":"32035862-e374-419f-ba1f-06fa7dfe3d94","Type":"ContainerStarted","Data":"69af92fbab8b761af61613885d2bb11ffb522b9589ac4df844d689dc18214680"}
Aug 05 16:30:14.718840 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:14.718461    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:30:14.743849 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:14.743791    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7" podStartSLOduration=2.182604298 podStartE2EDuration="4.743772399s" totalImagesPullingTime="2.561168101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:30:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:30:14.743007395 +0000 UTC m=+529.004318006" watchObservedRunningTime="2026-08-05 16:30:14.743772399 +0000 UTC m=+529.005082998"
Aug 05 16:30:14.745586 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:14.745547    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n" podStartSLOduration=4.599130831 podStartE2EDuration="7.745533909s" totalImagesPullingTime="3.146403078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:30:11.720651787 +0000 UTC m=+525.981962401" watchObservedRunningTime="2026-08-05 16:30:14.745533909 +0000 UTC m=+529.006844507"
Aug 05 16:30:22.707517 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:22.707436    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-ql82n"
Aug 05 16:30:25.726694 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:30:25.726656    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-p9jz7"
Aug 05 16:31:04.051382 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.051346    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:31:04.053718 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.053697    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.056409 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.056387    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Aug 05 16:31:04.056512 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.056480    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-snx4g\""
Aug 05 16:31:04.070200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.070175    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:31:04.109667 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.109633    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:31:04.133816 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.133781    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2bwp\" (UniqueName: \"kubernetes.io/projected/94800ea5-0190-4c01-b71c-523c3bb0674d-kube-api-access-p2bwp\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.133979 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.133848    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94800ea5-0190-4c01-b71c-523c3bb0674d-config-file\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.234273 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.234244    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2bwp\" (UniqueName: \"kubernetes.io/projected/94800ea5-0190-4c01-b71c-523c3bb0674d-kube-api-access-p2bwp\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.234478 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.234303    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94800ea5-0190-4c01-b71c-523c3bb0674d-config-file\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.234949 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.234926    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94800ea5-0190-4c01-b71c-523c3bb0674d-config-file\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.243836 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.243810    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2bwp\" (UniqueName: \"kubernetes.io/projected/94800ea5-0190-4c01-b71c-523c3bb0674d-kube-api-access-p2bwp\") pod \"limitador-limitador-85d9db4d5d-x7cbq\" (UID: \"94800ea5-0190-4c01-b71c-523c3bb0674d\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.364613 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.364582    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:04.510491 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.510467    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:31:04.511854 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:31:04.511827    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94800ea5_0190_4c01_b71c_523c3bb0674d.slice/crio-bf6ff5616584caa75bd2d583083565476dbb557fb62f5f9b69c28e325dd7737a WatchSource:0}: Error finding container bf6ff5616584caa75bd2d583083565476dbb557fb62f5f9b69c28e325dd7737a: Status 404 returned error can't find the container with id bf6ff5616584caa75bd2d583083565476dbb557fb62f5f9b69c28e325dd7737a
Aug 05 16:31:04.983231 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:04.983189    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq" event={"ID":"94800ea5-0190-4c01-b71c-523c3bb0674d","Type":"ContainerStarted","Data":"bf6ff5616584caa75bd2d583083565476dbb557fb62f5f9b69c28e325dd7737a"}
Aug 05 16:31:05.989717 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:05.989683    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq" event={"ID":"94800ea5-0190-4c01-b71c-523c3bb0674d","Type":"ContainerStarted","Data":"7b8e5d1aa589740b4765ae17b2622f68d677cffd401b57c58572453102543304"}
Aug 05 16:31:05.990172 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:05.989742    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:06.014473 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:06.014432    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq" podStartSLOduration=0.980256238 podStartE2EDuration="2.014419073s" totalImagesPullingTime="1.034162835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:31:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:31:06.014042399 +0000 UTC m=+580.275352996" watchObservedRunningTime="2026-08-05 16:31:06.014419073 +0000 UTC m=+580.275729670"
Aug 05 16:31:16.997587 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:16.997551    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"
Aug 05 16:31:26.186342 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:26.186308    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:31:26.188366 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:31:26.188345    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:32:17.366698 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:17.366663    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:32:34.713442 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:34.713410    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:32:39.226510 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.226478    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"]
Aug 05 16:32:39.229778 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.229759    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.233027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.233003    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Aug 05 16:32:39.233162 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.233053    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Aug 05 16:32:39.233162 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.233028    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-dck4v\""
Aug 05 16:32:39.233162 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.233033    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Aug 05 16:32:39.253504 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.253467    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"]
Aug 05 16:32:39.255920 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.255894    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.256053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.255936    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70205647-bee7-48bf-96b5-ccb59563f331-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.256053 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.255965    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.256139 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.256053    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.256139 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.256093    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.256139 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.256125    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l89pg\" (UniqueName: \"kubernetes.io/projected/70205647-bee7-48bf-96b5-ccb59563f331-kube-api-access-l89pg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.356763 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.356718    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.356979 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.356780    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.356979 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.356812    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l89pg\" (UniqueName: \"kubernetes.io/projected/70205647-bee7-48bf-96b5-ccb59563f331-kube-api-access-l89pg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.356979 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.356956    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.357165 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.357010    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70205647-bee7-48bf-96b5-ccb59563f331-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.357165 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.357037    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.357274 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.357229    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.357381 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.357364    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.357464 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.357423    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.359354 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.359312    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70205647-bee7-48bf-96b5-ccb59563f331-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.359595 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.359580    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70205647-bee7-48bf-96b5-ccb59563f331-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.373287 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.373260    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l89pg\" (UniqueName: \"kubernetes.io/projected/70205647-bee7-48bf-96b5-ccb59563f331-kube-api-access-l89pg\") pod \"e2e-distinct-simulated-kserve-59975d69f9-m8s8b\" (UID: \"70205647-bee7-48bf-96b5-ccb59563f331\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.540554 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.540465    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:39.679247 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.679216    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"]
Aug 05 16:32:39.679637 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:32:39.679615    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70205647_bee7_48bf_96b5_ccb59563f331.slice/crio-e6561b751087e945079c93216018b765116cb2a448deb0b4a5605bbba33c9c20 WatchSource:0}: Error finding container e6561b751087e945079c93216018b765116cb2a448deb0b4a5605bbba33c9c20: Status 404 returned error can't find the container with id e6561b751087e945079c93216018b765116cb2a448deb0b4a5605bbba33c9c20
Aug 05 16:32:39.680883 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:39.680866    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:32:40.004640 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:40.004595    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:32:40.504995 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:40.504947    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b" event={"ID":"70205647-bee7-48bf-96b5-ccb59563f331","Type":"ContainerStarted","Data":"e6561b751087e945079c93216018b765116cb2a448deb0b4a5605bbba33c9c20"}
Aug 05 16:32:41.511943 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:41.511904    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b" event={"ID":"70205647-bee7-48bf-96b5-ccb59563f331","Type":"ContainerStarted","Data":"7a962565bdab224fcae6d8e8d5f92d1932a32225bb93a798bfe7a3d15a03adcf"}
Aug 05 16:32:41.537959 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:41.537907    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b" podStartSLOduration=1.5231106699999999 podStartE2EDuration="2.537891655s" totalImagesPullingTime="1.014780985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:32:41.53650757 +0000 UTC m=+675.797818168" watchObservedRunningTime="2026-08-05 16:32:41.537891655 +0000 UTC m=+675.799202252"
Aug 05 16:32:49.540623 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:49.540588    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:49.541014 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:49.540640    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:49.553472 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:49.553449    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:32:49.564552 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:32:49.564525    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-m8s8b"
Aug 05 16:33:09.919972 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:09.919929    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:33:23.196796 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.196713    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"]
Aug 05 16:33:23.199536 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.199521    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.201875 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.201854    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Aug 05 16:33:23.209821 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.209801    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"]
Aug 05 16:33:23.243751 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243722    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.243894 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243760    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmk82\" (UniqueName: \"kubernetes.io/projected/ed3877d4-362a-4139-b4b5-59fc84c98aa7-kube-api-access-nmk82\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.243894 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243793    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.243991 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243899    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.243991 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243940    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.244072 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.243997    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.344855 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.344820    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.344868    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.344919    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.344951    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.344976    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmk82\" (UniqueName: \"kubernetes.io/projected/ed3877d4-362a-4139-b4b5-59fc84c98aa7-kube-api-access-nmk82\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345236 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.345080    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345318 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.345267    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345318 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.345283    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.345450 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.345423    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.347341 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.347300    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ed3877d4-362a-4139-b4b5-59fc84c98aa7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.347609 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.347590    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ed3877d4-362a-4139-b4b5-59fc84c98aa7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.354815 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.354791    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmk82\" (UniqueName: \"kubernetes.io/projected/ed3877d4-362a-4139-b4b5-59fc84c98aa7-kube-api-access-nmk82\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s\" (UID: \"ed3877d4-362a-4139-b4b5-59fc84c98aa7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.510116 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.510023    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:23.673566 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.673542    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"]
Aug 05 16:33:23.675522 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:33:23.675487    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded3877d4_362a_4139_b4b5_59fc84c98aa7.slice/crio-610f2a6242dcba9fa111cd4b513288b5e92a002ecdfaccd0ad9c23e902e04a46 WatchSource:0}: Error finding container 610f2a6242dcba9fa111cd4b513288b5e92a002ecdfaccd0ad9c23e902e04a46: Status 404 returned error can't find the container with id 610f2a6242dcba9fa111cd4b513288b5e92a002ecdfaccd0ad9c23e902e04a46
Aug 05 16:33:23.731891 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:23.731857    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s" event={"ID":"ed3877d4-362a-4139-b4b5-59fc84c98aa7","Type":"ContainerStarted","Data":"610f2a6242dcba9fa111cd4b513288b5e92a002ecdfaccd0ad9c23e902e04a46"}
Aug 05 16:33:24.497949 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:24.497917    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:33:24.738391 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:24.738354    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s" event={"ID":"ed3877d4-362a-4139-b4b5-59fc84c98aa7","Type":"ContainerStarted","Data":"5166d8e2c98289ab4779a8e1e5e80848a4aaaf0f321d77232f21f1e1f4b09fab"}
Aug 05 16:33:24.765844 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:24.765747    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s" podStartSLOduration=1.601172982 podStartE2EDuration="1.765729875s" totalImagesPullingTime="164.556893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:33:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:33:24.76496536 +0000 UTC m=+719.026275959" watchObservedRunningTime="2026-08-05 16:33:24.765729875 +0000 UTC m=+719.027040472"
Aug 05 16:33:33.510384 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:33.510348    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:33.510841 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:33.510445    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:33.522808 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:33.522787    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:33.797659 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:33.797575    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s"
Aug 05 16:33:52.092567 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:33:52.092533    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:34:01.689113 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:34:01.689080    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:35:22.800687 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:35:22.800655    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:35:32.497710 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:35:32.497677    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:35:45.903108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:35:45.903072    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:36:26.222263 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:36:26.222229    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:36:26.232108 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:36:26.232084    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:37:22.194460 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:37:22.194422    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:37:31.301573 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:37:31.301541    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:38:31.191824 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:38:31.191788    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:38:38.105731 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:38:38.105695    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:38:53.300219 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:38:53.300183    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:38:59.313230 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:38:59.313197    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:09.330144 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:09.330107    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:19.306971 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:19.306893    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:31.613022 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:31.612985    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:43.003886 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:43.003849    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:50.603161 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:50.603123    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:39:56.808316 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:39:56.808282    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:40:09.622991 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:40:09.622954    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:40:20.010925 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:40:20.010885    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:40:45.602424 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:40:45.602390    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:40:56.006134 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:40:56.006055    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:01.112524 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:01.112488    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:09.135698 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:09.135665    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:17.366402 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:17.366366    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:22.324957 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:22.324922    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:26.271429 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:26.271394    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:41:26.271838 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:26.271673    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:41:27.250109 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:27.250076    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:38.434112 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:38.434079    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:48.309559 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:48.309527    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:41:58.006094 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:41:58.006062    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:42:09.004407 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:42:09.004360    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:42:20.008400 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:42:20.008280    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:42:25.121211 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:42:25.121171    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:42:30.704183 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:42:30.704150    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:42:40.421356 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:42:40.421309    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:44:57.405495 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:44:57.405459    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:45:02.806113 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:45:02.806079    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:45:28.202776 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:45:28.202742    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:05.903776 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:05.903738    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:12.503985 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:12.503948    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:21.805282 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:21.805245    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:26.305670 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:26.305633    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:46:26.308349 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:26.308303    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:46:26.903942 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:26.903912    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:38.310456 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:38.310428    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:47.932754 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:47.932710    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:53.100209 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:53.100123    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:46:58.005420 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:46:58.005383    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:47:08.536678 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:47:08.536636    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:47:19.400746 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:47:19.400711    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:47:23.705200 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:47:23.705156    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:47:45.821389 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:47:45.821347    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:47:53.203846 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:47:53.203814    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:48:18.104181 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:48:18.104132    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:48:32.303503 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:48:32.303460    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:48:57.300132 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:48:57.300098    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:07.807737 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:07.807702    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:12.613493 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:12.613452    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:22.705801 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:22.705755    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:46.502082 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:46.502047    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:53.246573 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:53.246484    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:49:59.803015 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:49:59.802980    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:08.398795 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:08.398764    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:18.512076 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:18.512038    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:25.515646 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:25.515613    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:41.215640 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:41.215603    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:48.609661 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:48.609621    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:50:59.920866 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:50:59.920832    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:07.418049 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:07.418015    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:14.626676 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:14.626641    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:19.807857 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:19.807775    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:26.341991 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:26.341957    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:51:26.344498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:26.344478    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:51:26.597685 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:26.597604    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:36.746099 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:36.746063    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:43.311033 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:43.310993    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:51:53.723027 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:51:53.722989    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:00.310337 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:00.310286    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:10.708428 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:10.708383    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:26.001126 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:26.001093    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:32.830702 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:32.830667    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:42.902415 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:42.902375    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:50.310485 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:50.310411    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:52:58.817299 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:52:58.817260    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:53:07.813202 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:53:07.813162    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:53:19.715498 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:53:19.715461    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:53:49.399667 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:53:49.399629    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:53:58.812153 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:53:58.812113    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:54:46.505599 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:54:46.505559    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:54:55.930121 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:54:55.930092    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:55:13.813770 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.813736    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"]
Aug 05 16:55:13.817068 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.817053    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:13.819471 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.819451    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 16:55:13.820068 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.820049    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 16:55:13.828250 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.828228    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"]
Aug 05 16:55:13.833925 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.833898    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq\" (UID: \"1106147a-f8aa-4a03-9efd-264d53f0341a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:13.935152 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.935118    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq\" (UID: \"1106147a-f8aa-4a03-9efd-264d53f0341a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:13.935803 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:13.935777    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq\" (UID: \"1106147a-f8aa-4a03-9efd-264d53f0341a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:14.127940 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:14.127899    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:14.268749 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:14.268727    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"]
Aug 05 16:55:14.270767 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:55:14.270741    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1106147a_f8aa_4a03_9efd_264d53f0341a.slice/crio-6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e WatchSource:0}: Error finding container 6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e: Status 404 returned error can't find the container with id 6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e
Aug 05 16:55:14.272779 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:14.272764    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 16:55:14.817120 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:14.817086    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq" event={"ID":"1106147a-f8aa-4a03-9efd-264d53f0341a","Type":"ContainerStarted","Data":"6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e"}
Aug 05 16:55:17.835175 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:17.835144    2546 generic.go:356] "Generic (PLEG): container finished" podID="1106147a-f8aa-4a03-9efd-264d53f0341a" containerID="55fdc8d1f18e379fefd7eb414c2824a26e506247fbdfd1ed5e3fc2d8407827ba" exitCode=0
Aug 05 16:55:17.835688 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:17.835228    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq" event={"ID":"1106147a-f8aa-4a03-9efd-264d53f0341a","Type":"ContainerDied","Data":"55fdc8d1f18e379fefd7eb414c2824a26e506247fbdfd1ed5e3fc2d8407827ba"}
Aug 05 16:55:18.977593 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:18.977568    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:19.081946 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.081911    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca\") pod \"1106147a-f8aa-4a03-9efd-264d53f0341a\" (UID: \"1106147a-f8aa-4a03-9efd-264d53f0341a\") "
Aug 05 16:55:19.082377 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.082357    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1106147a-f8aa-4a03-9efd-264d53f0341a" (UID: "1106147a-f8aa-4a03-9efd-264d53f0341a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:55:19.183728 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.183641    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1106147a-f8aa-4a03-9efd-264d53f0341a-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:55:19.846735 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.846701    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq" event={"ID":"1106147a-f8aa-4a03-9efd-264d53f0341a","Type":"ContainerDied","Data":"6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e"}
Aug 05 16:55:19.846735 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.846739    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"
Aug 05 16:55:19.846951 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:19.846750    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b6e3598e151795881ff44acb7b6271858e8ba97c26ed006a02e4f3652c6294e"
Aug 05 16:55:30.182535 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:30.182498    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"]
Aug 05 16:55:30.185508 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:30.185484    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ff3f79bc-fn7wq"]
Aug 05 16:55:30.311246 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:30.311214    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1106147a-f8aa-4a03-9efd-264d53f0341a" path="/var/lib/kubelet/pods/1106147a-f8aa-4a03-9efd-264d53f0341a/volumes"
Aug 05 16:55:33.236938 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:33.236904    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:55:39.225451 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:55:39.225415    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:56:11.250029 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:56:11.249939    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:56:21.496048 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:56:21.496012    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:56:26.379398 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:56:26.379365    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:56:26.382962 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:56:26.382941    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 16:57:52.024483 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:57:52.024447    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:58:01.895801 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:01.895766    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:58:14.494620 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:14.494588    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:58:43.074222 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.074184    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"]
Aug 05 16:58:43.074740 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.074615    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1106147a-f8aa-4a03-9efd-264d53f0341a" containerName="revoke-keys"
Aug 05 16:58:43.074740 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.074626    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="1106147a-f8aa-4a03-9efd-264d53f0341a" containerName="revoke-keys"
Aug 05 16:58:43.074740 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.074688    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="1106147a-f8aa-4a03-9efd-264d53f0341a" containerName="revoke-keys"
Aug 05 16:58:43.077784 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.077768    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:43.080029 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.080000    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 16:58:43.080029 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.080012    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 16:58:43.088687 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.088658    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"]
Aug 05 16:58:43.168606 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.168571    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-29433603-jdjxt\" (UID: \"157a2b9d-b6a6-40e3-a2e1-af655248298d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:43.269431 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.269397    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-29433603-jdjxt\" (UID: \"157a2b9d-b6a6-40e3-a2e1-af655248298d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:43.270013 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.269992    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-29433603-jdjxt\" (UID: \"157a2b9d-b6a6-40e3-a2e1-af655248298d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:43.388711 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.388677    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:43.521479 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.521457    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"]
Aug 05 16:58:43.522811 ip-10-0-134-153 kubenswrapper[2546]: W0805 16:58:43.522782    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157a2b9d_b6a6_40e3_a2e1_af655248298d.slice/crio-49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95 WatchSource:0}: Error finding container 49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95: Status 404 returned error can't find the container with id 49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95
Aug 05 16:58:43.950791 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.950755    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt" event={"ID":"157a2b9d-b6a6-40e3-a2e1-af655248298d","Type":"ContainerStarted","Data":"0ed771230aeca376eb976e538b57668f78dc616dd3e3e8a25fe1105609ef92c0"}
Aug 05 16:58:43.950977 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.950811    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt" event={"ID":"157a2b9d-b6a6-40e3-a2e1-af655248298d","Type":"ContainerStarted","Data":"49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95"}
Aug 05 16:58:43.969013 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:43.968966    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt" podStartSLOduration=0.968952317 podStartE2EDuration="968.952317ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 16:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 16:58:43.966357384 +0000 UTC m=+2238.227667980" watchObservedRunningTime="2026-08-05 16:58:43.968952317 +0000 UTC m=+2238.230262915"
Aug 05 16:58:44.957974 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:44.957939    2546 generic.go:356] "Generic (PLEG): container finished" podID="157a2b9d-b6a6-40e3-a2e1-af655248298d" containerID="0ed771230aeca376eb976e538b57668f78dc616dd3e3e8a25fe1105609ef92c0" exitCode=0
Aug 05 16:58:44.958418 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:44.958015    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt" event={"ID":"157a2b9d-b6a6-40e3-a2e1-af655248298d","Type":"ContainerDied","Data":"0ed771230aeca376eb976e538b57668f78dc616dd3e3e8a25fe1105609ef92c0"}
Aug 05 16:58:46.107103 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.107077    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:46.299094 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.299020    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca\") pod \"157a2b9d-b6a6-40e3-a2e1-af655248298d\" (UID: \"157a2b9d-b6a6-40e3-a2e1-af655248298d\") "
Aug 05 16:58:46.299344 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.299309    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "157a2b9d-b6a6-40e3-a2e1-af655248298d" (UID: "157a2b9d-b6a6-40e3-a2e1-af655248298d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 16:58:46.400176 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.400142    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/157a2b9d-b6a6-40e3-a2e1-af655248298d-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 16:58:46.970570 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.970533    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"
Aug 05 16:58:46.970570 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.970558    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt" event={"ID":"157a2b9d-b6a6-40e3-a2e1-af655248298d","Type":"ContainerDied","Data":"49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95"}
Aug 05 16:58:46.970790 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:46.970609    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49761c903797e1800cbb01711e5929824ae1d5993e1426b3a9bf774536c50f95"
Aug 05 16:58:53.946514 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:53.946370    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"]
Aug 05 16:58:53.948520 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:53.948488    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-29433603-jdjxt"]
Aug 05 16:58:54.310781 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:54.310677    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="157a2b9d-b6a6-40e3-a2e1-af655248298d" path="/var/lib/kubelet/pods/157a2b9d-b6a6-40e3-a2e1-af655248298d/volumes"
Aug 05 16:58:55.694838 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:58:55.694795    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 16:59:32.512891 ip-10-0-134-153 kubenswrapper[2546]: I0805 16:59:32.512854    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:01:18.893457 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:18.893416    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:01:26.420062 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:26.420029    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:01:26.425640 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:26.425614    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:01:26.459903 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:26.459874    2546 scope.go:117] "RemoveContainer" containerID="55fdc8d1f18e379fefd7eb414c2824a26e506247fbdfd1ed5e3fc2d8407827ba"
Aug 05 17:01:29.213529 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:29.213494    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:01:53.204137 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:01:53.204061    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:02:10.095124 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:10.095089    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:02:18.663015 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.662974    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"]
Aug 05 17:02:18.663546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.663422    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="157a2b9d-b6a6-40e3-a2e1-af655248298d" containerName="revoke-keys"
Aug 05 17:02:18.663546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.663437    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="157a2b9d-b6a6-40e3-a2e1-af655248298d" containerName="revoke-keys"
Aug 05 17:02:18.663546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.663529    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="157a2b9d-b6a6-40e3-a2e1-af655248298d" containerName="revoke-keys"
Aug 05 17:02:18.666707 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.666684    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:18.669400 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.669380    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:02:18.669608 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.669595    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:02:18.675624 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.675603    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"]
Aug 05 17:02:18.764502 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.764467    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2645e95-qksmm\" (UID: \"720d53c9-2a1f-4b41-b488-df5e16906352\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:18.865010 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.864965    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2645e95-qksmm\" (UID: \"720d53c9-2a1f-4b41-b488-df5e16906352\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:18.865631 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.865612    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-d2645e95-qksmm\" (UID: \"720d53c9-2a1f-4b41-b488-df5e16906352\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:18.978104 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:18.978016    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:19.110837 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:19.110815    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"]
Aug 05 17:02:19.112177 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:02:19.112141    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720d53c9_2a1f_4b41_b488_df5e16906352.slice/crio-e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321 WatchSource:0}: Error finding container e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321: Status 404 returned error can't find the container with id e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321
Aug 05 17:02:19.136473 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:19.136442    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm" event={"ID":"720d53c9-2a1f-4b41-b488-df5e16906352","Type":"ContainerStarted","Data":"e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321"}
Aug 05 17:02:20.143179 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:20.143137    2546 generic.go:356] "Generic (PLEG): container finished" podID="720d53c9-2a1f-4b41-b488-df5e16906352" containerID="fa1550bbb3becb7430709426e6d55b86bee5ca9bf823c6648dd3134fa52c643c" exitCode=0
Aug 05 17:02:20.143617 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:20.143185    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm" event={"ID":"720d53c9-2a1f-4b41-b488-df5e16906352","Type":"ContainerDied","Data":"fa1550bbb3becb7430709426e6d55b86bee5ca9bf823c6648dd3134fa52c643c"}
Aug 05 17:02:21.281053 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:21.281029    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:21.284259 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:21.284240    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca\") pod \"720d53c9-2a1f-4b41-b488-df5e16906352\" (UID: \"720d53c9-2a1f-4b41-b488-df5e16906352\") "
Aug 05 17:02:21.284583 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:21.284561    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "720d53c9-2a1f-4b41-b488-df5e16906352" (UID: "720d53c9-2a1f-4b41-b488-df5e16906352"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:02:21.385190 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:21.385162    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/720d53c9-2a1f-4b41-b488-df5e16906352-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:02:22.162184 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:22.162148    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"
Aug 05 17:02:22.162410 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:22.162143    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm" event={"ID":"720d53c9-2a1f-4b41-b488-df5e16906352","Type":"ContainerDied","Data":"e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321"}
Aug 05 17:02:22.162410 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:22.162310    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e95f98442ae32acc8420868d62b13b3d1f0c68fa4dc9b099f2f0d899aee27321"
Aug 05 17:02:32.201478 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:32.201443    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:02:35.012876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:35.012838    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"]
Aug 05 17:02:35.017736 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:35.017709    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-d2645e95-qksmm"]
Aug 05 17:02:36.310610 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:36.310576    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720d53c9-2a1f-4b41-b488-df5e16906352" path="/var/lib/kubelet/pods/720d53c9-2a1f-4b41-b488-df5e16906352/volumes"
Aug 05 17:02:37.800215 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:02:37.800183    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:03:28.816221 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:03:28.816188    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:03:41.315387 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:03:41.315347    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:03:49.406575 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:03:49.406539    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:03:57.496802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:03:57.496763    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:04:41.799508 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:04:41.799471    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:05:08.723142 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.722941    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:05:08.723695 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.723651    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720d53c9-2a1f-4b41-b488-df5e16906352" containerName="revoke-keys"
Aug 05 17:05:08.723695 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.723675    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="720d53c9-2a1f-4b41-b488-df5e16906352" containerName="revoke-keys"
Aug 05 17:05:08.723821 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.723797    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="720d53c9-2a1f-4b41-b488-df5e16906352" containerName="revoke-keys"
Aug 05 17:05:08.726530 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.726509    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.731285 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.731266    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-034ebc-dockercfg-wr2xf\""
Aug 05 17:05:08.731828 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.731810    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-034ebc\""
Aug 05 17:05:08.744769 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.744743    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:05:08.778850 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.778806    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.779009 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.778873    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbckc\" (UniqueName: \"kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.880237 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.880199    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.880237 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.880236    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbckc\" (UniqueName: \"kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.880940 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.880918    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:08.900257 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:08.900226    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbckc\" (UniqueName: \"kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc\") pod \"payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") " pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:09.037457 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:09.037371    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:09.386962 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:09.386937    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:05:09.388050 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:05:09.388028    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a845fff_50c8_4922_8b8c_37db726ab0e1.slice/crio-e8c3f6b51a594a80eee6299c9a684d5dc0407158fa603ceec438e504fe746d66 WatchSource:0}: Error finding container e8c3f6b51a594a80eee6299c9a684d5dc0407158fa603ceec438e504fe746d66: Status 404 returned error can't find the container with id e8c3f6b51a594a80eee6299c9a684d5dc0407158fa603ceec438e504fe746d66
Aug 05 17:05:09.389972 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:09.389951    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:05:10.088228 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:10.088197    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" event={"ID":"1a845fff-50c8-4922-8b8c-37db726ab0e1","Type":"ContainerStarted","Data":"e8c3f6b51a594a80eee6299c9a684d5dc0407158fa603ceec438e504fe746d66"}
Aug 05 17:05:11.595529 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:11.595500    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:05:12.101389 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:12.101350    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" event={"ID":"1a845fff-50c8-4922-8b8c-37db726ab0e1","Type":"ContainerStarted","Data":"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"}
Aug 05 17:05:12.101635 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:12.101457    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:12.125432 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:12.125370    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" podStartSLOduration=2.033520487 podStartE2EDuration="4.125353068s" totalImagesPullingTime="2.091832581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:05:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:05:12.123056789 +0000 UTC m=+2626.384367388" watchObservedRunningTime="2026-08-05 17:05:12.125353068 +0000 UTC m=+2626.386663683"
Aug 05 17:05:23.109535 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:23.109502    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:05:26.509160 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:26.509131    2546 scope.go:117] "RemoveContainer" containerID="0ed771230aeca376eb976e538b57668f78dc616dd3e3e8a25fe1105609ef92c0"
Aug 05 17:05:44.500711 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:44.500673    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:05:49.602292 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:05:49.602258    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:06:06.214546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.214511    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:06:06.217870 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.217854    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.220210 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.220186    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-034ebc\"/\"test-model-034ebc-kserve-self-signed-certs\""
Aug 05 17:06:06.220774 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.220749    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-034ebc\"/\"kube-root-ca.crt\""
Aug 05 17:06:06.221080 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.221064    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-034ebc\"/\"default-dockercfg-gh4qq\""
Aug 05 17:06:06.221133 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.221086    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-034ebc\"/\"openshift-service-ca.crt\""
Aug 05 17:06:06.236817 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.236782    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:06:06.284436 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284406    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.284594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284442    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.284594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284484    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sq4q\" (UniqueName: \"kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.284594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284528    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.284703 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284604    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.284703 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.284629    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385629 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385596    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385641    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sq4q\" (UniqueName: \"kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385684    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385728    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385749    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.385802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.385787    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.386203 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.386177    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.386288 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.386235    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.386288 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.386267    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.387982 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.387961    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.388122 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.388107    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.395575 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.395553    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sq4q\" (UniqueName: \"kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q\") pod \"test-model-034ebc-kserve-8475cbc667-fqzlk\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") " pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.527792 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.527705    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:06.672521 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:06.672498    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:06:06.675094 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:06:06.675060    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86237a7a_8825_4332_81db_5de5848f0d43.slice/crio-feb846d50b9f53537eb12090a954bcd87e5816672c105d32a6c7aa294dd18b1d WatchSource:0}: Error finding container feb846d50b9f53537eb12090a954bcd87e5816672c105d32a6c7aa294dd18b1d: Status 404 returned error can't find the container with id feb846d50b9f53537eb12090a954bcd87e5816672c105d32a6c7aa294dd18b1d
Aug 05 17:06:07.412123 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:07.412085    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" event={"ID":"86237a7a-8825-4332-81db-5de5848f0d43","Type":"ContainerStarted","Data":"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"}
Aug 05 17:06:07.412123 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:07.412127    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" event={"ID":"86237a7a-8825-4332-81db-5de5848f0d43","Type":"ContainerStarted","Data":"feb846d50b9f53537eb12090a954bcd87e5816672c105d32a6c7aa294dd18b1d"}
Aug 05 17:06:07.443286 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:07.443238    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" podStartSLOduration=1.443224106 podStartE2EDuration="1.443224106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:06:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:06:07.437800625 +0000 UTC m=+2681.699111223" watchObservedRunningTime="2026-08-05 17:06:07.443224106 +0000 UTC m=+2681.704534749"
Aug 05 17:06:09.145002 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:09.144968    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:06:16.528198 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:16.528159    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:16.528743 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:16.528222    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:16.540652 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:16.540629    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:17.478463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:17.478438    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:06:17.702163 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:17.702129    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:06:26.455292 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:26.455265    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:06:26.463412 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:26.463391    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:06:52.177156 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.177120    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:06:52.328211 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.328172    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"]
Aug 05 17:06:52.331499 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.331477    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:52.334061 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.334039    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:06:52.334166 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.334065    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:06:52.343906 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.343881    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"]
Aug 05 17:06:52.398381 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.398347    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5\" (UID: \"7c68af52-db6c-40a2-89e6-f58117dd9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:52.499116 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.499032    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5\" (UID: \"7c68af52-db6c-40a2-89e6-f58117dd9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:52.499845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.499823    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5\" (UID: \"7c68af52-db6c-40a2-89e6-f58117dd9561\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:52.642177 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.642139    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:52.785341 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:52.785297    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"]
Aug 05 17:06:52.788124 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:06:52.788099    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c68af52_db6c_40a2_89e6_f58117dd9561.slice/crio-e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd WatchSource:0}: Error finding container e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd: Status 404 returned error can't find the container with id e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd
Aug 05 17:06:53.683392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:53.683356    2546 generic.go:356] "Generic (PLEG): container finished" podID="7c68af52-db6c-40a2-89e6-f58117dd9561" containerID="7375e725f5393a212230a1c462a5b74e4a089f0e5536dd4fc7cbbd223114ce80" exitCode=0
Aug 05 17:06:53.683789 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:53.683448    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5" event={"ID":"7c68af52-db6c-40a2-89e6-f58117dd9561","Type":"ContainerDied","Data":"7375e725f5393a212230a1c462a5b74e4a089f0e5536dd4fc7cbbd223114ce80"}
Aug 05 17:06:53.683789 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:53.683513    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5" event={"ID":"7c68af52-db6c-40a2-89e6-f58117dd9561","Type":"ContainerStarted","Data":"e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd"}
Aug 05 17:06:54.557205 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:54.557168    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:06:54.832578 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:54.832555    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:54.921448 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:54.921415    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca\") pod \"7c68af52-db6c-40a2-89e6-f58117dd9561\" (UID: \"7c68af52-db6c-40a2-89e6-f58117dd9561\") "
Aug 05 17:06:54.921759 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:54.921737    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7c68af52-db6c-40a2-89e6-f58117dd9561" (UID: "7c68af52-db6c-40a2-89e6-f58117dd9561"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:06:55.022479 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:55.022426    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7c68af52-db6c-40a2-89e6-f58117dd9561-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:06:55.705710 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:55.705681    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"
Aug 05 17:06:55.705885 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:55.705680    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5" event={"ID":"7c68af52-db6c-40a2-89e6-f58117dd9561","Type":"ContainerDied","Data":"e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd"}
Aug 05 17:06:55.705885 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:06:55.705836    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e32185b5ac18f651ff9636a7908e868f00cca546dc4eee9a57d59258d74d53dd"
Aug 05 17:07:03.162591 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:03.162556    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"]
Aug 05 17:07:03.166066 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:03.166043    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-09f3f8-pg2w5"]
Aug 05 17:07:04.310483 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:04.310446    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c68af52-db6c-40a2-89e6-f58117dd9561" path="/var/lib/kubelet/pods/7c68af52-db6c-40a2-89e6-f58117dd9561/volumes"
Aug 05 17:07:05.003803 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:05.003754    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:07:07.196060 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.196001    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" podUID="86237a7a-8825-4332-81db-5de5848f0d43" containerName="main" containerID="cri-o://357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721" gracePeriod=45
Aug 05 17:07:07.451423 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.451359    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:07:07.538450 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538413    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sq4q\" (UniqueName: \"kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538654 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538478    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538654 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538545    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538654 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538600    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538654 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538629    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538862 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538699    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm\") pod \"86237a7a-8825-4332-81db-5de5848f0d43\" (UID: \"86237a7a-8825-4332-81db-5de5848f0d43\") "
Aug 05 17:07:07.538862 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538745    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:07.538862 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538790    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home" (OuterVolumeSpecName: "home") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:07.539017 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.538892    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache" (OuterVolumeSpecName: "model-cache") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:07.539017 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.539013    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-tmp-dir\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.539116 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.539027    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-home\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.539116 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.539036    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-model-cache\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.540935 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.540909    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:07:07.541048 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.540943    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm" (OuterVolumeSpecName: "dshm") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:07:07.541048 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.540959    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q" (OuterVolumeSpecName: "kube-api-access-2sq4q") pod "86237a7a-8825-4332-81db-5de5848f0d43" (UID: "86237a7a-8825-4332-81db-5de5848f0d43"). InnerVolumeSpecName "kube-api-access-2sq4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:07.640284 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.640248    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/86237a7a-8825-4332-81db-5de5848f0d43-dshm\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.640284 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.640280    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sq4q\" (UniqueName: \"kubernetes.io/projected/86237a7a-8825-4332-81db-5de5848f0d43-kube-api-access-2sq4q\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.640284 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.640291    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/86237a7a-8825-4332-81db-5de5848f0d43-tls-certs\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:07.772281 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.772198    2546 generic.go:356] "Generic (PLEG): container finished" podID="86237a7a-8825-4332-81db-5de5848f0d43" containerID="357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721" exitCode=0
Aug 05 17:07:07.772281 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.772247    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"
Aug 05 17:07:07.772494 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.772289    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" event={"ID":"86237a7a-8825-4332-81db-5de5848f0d43","Type":"ContainerDied","Data":"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"}
Aug 05 17:07:07.772494 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.772344    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk" event={"ID":"86237a7a-8825-4332-81db-5de5848f0d43","Type":"ContainerDied","Data":"feb846d50b9f53537eb12090a954bcd87e5816672c105d32a6c7aa294dd18b1d"}
Aug 05 17:07:07.772494 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.772367    2546 scope.go:117] "RemoveContainer" containerID="357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"
Aug 05 17:07:07.782092 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.782073    2546 scope.go:117] "RemoveContainer" containerID="357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"
Aug 05 17:07:07.782371 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:07:07.782348    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721\": container with ID starting with 357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721 not found: ID does not exist" containerID="357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"
Aug 05 17:07:07.782445 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.782379    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721"} err="failed to get container status \"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721\": rpc error: code = NotFound desc = could not find container \"357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721\": container with ID starting with 357ee65008456b370870aed998aa3211a89882453b7481cebe08a18527ce3721 not found: ID does not exist"
Aug 05 17:07:07.800831 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.800798    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:07:07.809232 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:07.809207    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-034ebc/test-model-034ebc-kserve-8475cbc667-fqzlk"]
Aug 05 17:07:08.311004 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:08.310967    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86237a7a-8825-4332-81db-5de5848f0d43" path="/var/lib/kubelet/pods/86237a7a-8825-4332-81db-5de5848f0d43/volumes"
Aug 05 17:07:11.006021 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.005987    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"]
Aug 05 17:07:11.006600 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006580    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c68af52-db6c-40a2-89e6-f58117dd9561" containerName="revoke-keys"
Aug 05 17:07:11.006688 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006604    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c68af52-db6c-40a2-89e6-f58117dd9561" containerName="revoke-keys"
Aug 05 17:07:11.006688 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006642    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86237a7a-8825-4332-81db-5de5848f0d43" containerName="main"
Aug 05 17:07:11.006688 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006652    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="86237a7a-8825-4332-81db-5de5848f0d43" containerName="main"
Aug 05 17:07:11.006845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006746    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c68af52-db6c-40a2-89e6-f58117dd9561" containerName="revoke-keys"
Aug 05 17:07:11.006845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.006759    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="86237a7a-8825-4332-81db-5de5848f0d43" containerName="main"
Aug 05 17:07:11.011267 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.011246    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:11.013475 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.013445    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:07:11.013588 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.013528    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:07:11.017829 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.017808    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"]
Aug 05 17:07:11.171398 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.171358    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf\" (UID: \"e081084e-71a4-4e11-afe7-ac5a4196483c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:11.272637 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.272547    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf\" (UID: \"e081084e-71a4-4e11-afe7-ac5a4196483c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:11.273173 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.273151    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf\" (UID: \"e081084e-71a4-4e11-afe7-ac5a4196483c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:11.322809 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.322771    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:11.668242 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.668217    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"]
Aug 05 17:07:11.669824 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:07:11.669799    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode081084e_71a4_4e11_afe7_ac5a4196483c.slice/crio-4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46 WatchSource:0}: Error finding container 4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46: Status 404 returned error can't find the container with id 4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46
Aug 05 17:07:11.795943 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:11.795907    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf" event={"ID":"e081084e-71a4-4e11-afe7-ac5a4196483c","Type":"ContainerStarted","Data":"4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46"}
Aug 05 17:07:12.803344 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:12.803293    2546 generic.go:356] "Generic (PLEG): container finished" podID="e081084e-71a4-4e11-afe7-ac5a4196483c" containerID="ec0b688bcca3d691d3bde64e1d1193af0f5ccc8b6cca42c353df43c9c8bd24d0" exitCode=0
Aug 05 17:07:12.803727 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:12.803358    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf" event={"ID":"e081084e-71a4-4e11-afe7-ac5a4196483c","Type":"ContainerDied","Data":"ec0b688bcca3d691d3bde64e1d1193af0f5ccc8b6cca42c353df43c9c8bd24d0"}
Aug 05 17:07:13.949555 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:13.949526    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:14.095077 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.095045    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca\") pod \"e081084e-71a4-4e11-afe7-ac5a4196483c\" (UID: \"e081084e-71a4-4e11-afe7-ac5a4196483c\") "
Aug 05 17:07:14.095446 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.095422    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e081084e-71a4-4e11-afe7-ac5a4196483c" (UID: "e081084e-71a4-4e11-afe7-ac5a4196483c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:14.196765 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.196726    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e081084e-71a4-4e11-afe7-ac5a4196483c-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:14.815674 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.815643    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"
Aug 05 17:07:14.815860 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.815676    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf" event={"ID":"e081084e-71a4-4e11-afe7-ac5a4196483c","Type":"ContainerDied","Data":"4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46"}
Aug 05 17:07:14.815860 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:14.815732    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e9778891b8b53d38e5aa8d969e34ea412e32e3ff5b4a87a5b93b9cc362c0d46"
Aug 05 17:07:15.707601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:15.707564    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:07:15.708064 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:15.707836    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" podUID="1a845fff-50c8-4922-8b8c-37db726ab0e1" containerName="payload-processing" containerID="cri-o://9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb" gracePeriod=30
Aug 05 17:07:15.908888 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:15.908857    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"]
Aug 05 17:07:15.911880 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:15.911851    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-034ebc-rprjf"]
Aug 05 17:07:15.977744 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:15.977721    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:07:16.112191 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.112157    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbckc\" (UniqueName: \"kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc\") pod \"1a845fff-50c8-4922-8b8c-37db726ab0e1\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") "
Aug 05 17:07:16.112367 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.112226    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume\") pod \"1a845fff-50c8-4922-8b8c-37db726ab0e1\" (UID: \"1a845fff-50c8-4922-8b8c-37db726ab0e1\") "
Aug 05 17:07:16.112648 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.112614    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a845fff-50c8-4922-8b8c-37db726ab0e1" (UID: "1a845fff-50c8-4922-8b8c-37db726ab0e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:07:16.114525 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.114498    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc" (OuterVolumeSpecName: "kube-api-access-wbckc") pod "1a845fff-50c8-4922-8b8c-37db726ab0e1" (UID: "1a845fff-50c8-4922-8b8c-37db726ab0e1"). InnerVolumeSpecName "kube-api-access-wbckc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:07:16.213263 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.213169    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbckc\" (UniqueName: \"kubernetes.io/projected/1a845fff-50c8-4922-8b8c-37db726ab0e1-kube-api-access-wbckc\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.213263 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.213205    2546 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a845fff-50c8-4922-8b8c-37db726ab0e1-plugins-config-volume\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:07:16.311021 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.310989    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e081084e-71a4-4e11-afe7-ac5a4196483c" path="/var/lib/kubelet/pods/e081084e-71a4-4e11-afe7-ac5a4196483c/volumes"
Aug 05 17:07:16.828316 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.828283    2546 generic.go:356] "Generic (PLEG): container finished" podID="1a845fff-50c8-4922-8b8c-37db726ab0e1" containerID="9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb" exitCode=0
Aug 05 17:07:16.828782 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.828339    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"
Aug 05 17:07:16.828782 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.828363    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" event={"ID":"1a845fff-50c8-4922-8b8c-37db726ab0e1","Type":"ContainerDied","Data":"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"}
Aug 05 17:07:16.828782 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.828422    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc" event={"ID":"1a845fff-50c8-4922-8b8c-37db726ab0e1","Type":"ContainerDied","Data":"e8c3f6b51a594a80eee6299c9a684d5dc0407158fa603ceec438e504fe746d66"}
Aug 05 17:07:16.828782 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.828445    2546 scope.go:117] "RemoveContainer" containerID="9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"
Aug 05 17:07:16.837451 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.837435    2546 scope.go:117] "RemoveContainer" containerID="9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"
Aug 05 17:07:16.837689 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:07:16.837672    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb\": container with ID starting with 9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb not found: ID does not exist" containerID="9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"
Aug 05 17:07:16.837734 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.837698    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb"} err="failed to get container status \"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb\": rpc error: code = NotFound desc = could not find container \"9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb\": container with ID starting with 9f0e83ff615021cf159472e8f7f7c30d407c965d0163732221a703ba0820c1fb not found: ID does not exist"
Aug 05 17:07:16.847077 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.847053    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:07:16.853620 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:16.853600    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-034ebc-5d6c97b6d6-gjxjc"]
Aug 05 17:07:17.790802 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:17.790770    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:07:18.310364 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:18.310313    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a845fff-50c8-4922-8b8c-37db726ab0e1" path="/var/lib/kubelet/pods/1a845fff-50c8-4922-8b8c-37db726ab0e1/volumes"
Aug 05 17:07:30.695133 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:30.695101    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:07:57.020167 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020080    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:07:57.020746 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020656    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e081084e-71a4-4e11-afe7-ac5a4196483c" containerName="revoke-keys"
Aug 05 17:07:57.020746 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020676    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e081084e-71a4-4e11-afe7-ac5a4196483c" containerName="revoke-keys"
Aug 05 17:07:57.020746 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020697    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a845fff-50c8-4922-8b8c-37db726ab0e1" containerName="payload-processing"
Aug 05 17:07:57.020746 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020706    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a845fff-50c8-4922-8b8c-37db726ab0e1" containerName="payload-processing"
Aug 05 17:07:57.020960 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020817    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e081084e-71a4-4e11-afe7-ac5a4196483c" containerName="revoke-keys"
Aug 05 17:07:57.020960 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.020835    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a845fff-50c8-4922-8b8c-37db726ab0e1" containerName="payload-processing"
Aug 05 17:07:57.024212 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.024187    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.026440 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.026421    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-f2130f-dockercfg-s8sqv\""
Aug 05 17:07:57.026547 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.026455    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-f2130f\""
Aug 05 17:07:57.036318 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.036291    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:07:57.166876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.166846    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.167058 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.166984    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrc2h\" (UniqueName: \"kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.267452 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.267418    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrc2h\" (UniqueName: \"kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.267623 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.267476    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.268157 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.268138    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.275172 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.275119    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrc2h\" (UniqueName: \"kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h\") pod \"payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") " pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.336712 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.336679    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:57.471947 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:57.471915    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:07:57.473271 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:07:57.473243    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd23bb795_fe76_4f12_8a7e_089322d55fb0.slice/crio-af19d1584c2749ead5a85ef038a2e40d4b6e6d5f62d18580ca44a9c5b784a0b4 WatchSource:0}: Error finding container af19d1584c2749ead5a85ef038a2e40d4b6e6d5f62d18580ca44a9c5b784a0b4: Status 404 returned error can't find the container with id af19d1584c2749ead5a85ef038a2e40d4b6e6d5f62d18580ca44a9c5b784a0b4
Aug 05 17:07:58.057230 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:58.057194    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" event={"ID":"d23bb795-fe76-4f12-8a7e-089322d55fb0","Type":"ContainerStarted","Data":"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"}
Aug 05 17:07:58.057753 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:58.057357    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:07:58.057753 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:58.057398    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" event={"ID":"d23bb795-fe76-4f12-8a7e-089322d55fb0","Type":"ContainerStarted","Data":"af19d1584c2749ead5a85ef038a2e40d4b6e6d5f62d18580ca44a9c5b784a0b4"}
Aug 05 17:07:58.075286 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:58.075226    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" podStartSLOduration=1.075210107 podStartE2EDuration="1.075210107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:07:58.073380333 +0000 UTC m=+2792.334690933" watchObservedRunningTime="2026-08-05 17:07:58.075210107 +0000 UTC m=+2792.336520705"
Aug 05 17:07:58.993605 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:07:58.993569    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:08:09.066266 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:09.066238    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:08:23.036998 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.036966    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"]
Aug 05 17:08:23.040574 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.040558    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:23.043010 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.042983    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:08:23.043156 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.043131    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:08:23.050913 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.050892    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"]
Aug 05 17:08:23.102719 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.102688    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf\" (UID: \"1ef25127-d862-4ee3-84fa-fa37909328f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:23.203773 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.203740    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf\" (UID: \"1ef25127-d862-4ee3-84fa-fa37909328f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:23.204309 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.204291    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf\" (UID: \"1ef25127-d862-4ee3-84fa-fa37909328f8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:23.351732 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.351705    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:23.518065 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:08:23.518035    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ef25127_d862_4ee3_84fa_fa37909328f8.slice/crio-7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6 WatchSource:0}: Error finding container 7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6: Status 404 returned error can't find the container with id 7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6
Aug 05 17:08:23.518435 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:23.518414    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"]
Aug 05 17:08:24.204605 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:24.204576    2546 generic.go:356] "Generic (PLEG): container finished" podID="1ef25127-d862-4ee3-84fa-fa37909328f8" containerID="4c537209425b8c96b6d4338b10ece839135004bcebc3413a8d2fdaf14d06de48" exitCode=0
Aug 05 17:08:24.205012 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:24.204631    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf" event={"ID":"1ef25127-d862-4ee3-84fa-fa37909328f8","Type":"ContainerDied","Data":"4c537209425b8c96b6d4338b10ece839135004bcebc3413a8d2fdaf14d06de48"}
Aug 05 17:08:24.205012 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:24.204672    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf" event={"ID":"1ef25127-d862-4ee3-84fa-fa37909328f8","Type":"ContainerStarted","Data":"7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6"}
Aug 05 17:08:25.343043 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:25.343019    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:25.432750 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:25.432714    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca\") pod \"1ef25127-d862-4ee3-84fa-fa37909328f8\" (UID: \"1ef25127-d862-4ee3-84fa-fa37909328f8\") "
Aug 05 17:08:25.433094 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:25.433014    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1ef25127-d862-4ee3-84fa-fa37909328f8" (UID: "1ef25127-d862-4ee3-84fa-fa37909328f8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:25.534299 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:25.534216    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ef25127-d862-4ee3-84fa-fa37909328f8-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:08:26.216458 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:26.216428    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"
Aug 05 17:08:26.216617 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:26.216506    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf" event={"ID":"1ef25127-d862-4ee3-84fa-fa37909328f8","Type":"ContainerDied","Data":"7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6"}
Aug 05 17:08:26.216617 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:26.216590    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7359035ad8a9bbbe59a45d7101ead696b3703d0a036726ad60f500eb60584bf6"
Aug 05 17:08:26.562084 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:26.562006    2546 scope.go:117] "RemoveContainer" containerID="fa1550bbb3becb7430709426e6d55b86bee5ca9bf823c6648dd3134fa52c643c"
Aug 05 17:08:38.879864 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:38.879826    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"]
Aug 05 17:08:38.885578 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:38.885551    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-64d8dc-dbnbf"]
Aug 05 17:08:40.309199 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:40.309164    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ef25127-d862-4ee3-84fa-fa37909328f8" path="/var/lib/kubelet/pods/1ef25127-d862-4ee3-84fa-fa37909328f8/volumes"
Aug 05 17:08:40.902104 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:40.902065    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:08:46.116956 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.116924    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"]
Aug 05 17:08:46.117375 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.117352    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ef25127-d862-4ee3-84fa-fa37909328f8" containerName="revoke-keys"
Aug 05 17:08:46.117375 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.117365    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ef25127-d862-4ee3-84fa-fa37909328f8" containerName="revoke-keys"
Aug 05 17:08:46.117474 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.117443    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ef25127-d862-4ee3-84fa-fa37909328f8" containerName="revoke-keys"
Aug 05 17:08:46.120770 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.120749    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:46.123127 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.123108    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:08:46.123250 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.123134    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:08:46.133138 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.133120    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"]
Aug 05 17:08:46.219409 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.219371    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw\" (UID: \"383185fc-80d9-4795-a9c7-5cd145eacb8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:46.319819 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.319779    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw\" (UID: \"383185fc-80d9-4795-a9c7-5cd145eacb8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:46.320501 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.320479    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw\" (UID: \"383185fc-80d9-4795-a9c7-5cd145eacb8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:46.430876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.430797    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:46.564256 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:46.564227    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"]
Aug 05 17:08:46.565423 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:08:46.565402    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod383185fc_80d9_4795_a9c7_5cd145eacb8c.slice/crio-61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd WatchSource:0}: Error finding container 61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd: Status 404 returned error can't find the container with id 61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd
Aug 05 17:08:47.343054 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:47.343019    2546 generic.go:356] "Generic (PLEG): container finished" podID="383185fc-80d9-4795-a9c7-5cd145eacb8c" containerID="7115d1a861f592568e0c6ca5dc20552680830ed497a93daadffa379566a2a78a" exitCode=0
Aug 05 17:08:47.343450 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:47.343061    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw" event={"ID":"383185fc-80d9-4795-a9c7-5cd145eacb8c","Type":"ContainerDied","Data":"7115d1a861f592568e0c6ca5dc20552680830ed497a93daadffa379566a2a78a"}
Aug 05 17:08:47.343450 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:47.343116    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw" event={"ID":"383185fc-80d9-4795-a9c7-5cd145eacb8c","Type":"ContainerStarted","Data":"61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd"}
Aug 05 17:08:48.481817 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:48.481795    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:48.642162 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:48.642072    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca\") pod \"383185fc-80d9-4795-a9c7-5cd145eacb8c\" (UID: \"383185fc-80d9-4795-a9c7-5cd145eacb8c\") "
Aug 05 17:08:48.642402 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:48.642380    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "383185fc-80d9-4795-a9c7-5cd145eacb8c" (UID: "383185fc-80d9-4795-a9c7-5cd145eacb8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:08:48.743041 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:48.743004    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/383185fc-80d9-4795-a9c7-5cd145eacb8c-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:08:49.355121 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:49.355092    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"
Aug 05 17:08:49.355276 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:49.355135    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw" event={"ID":"383185fc-80d9-4795-a9c7-5cd145eacb8c","Type":"ContainerDied","Data":"61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd"}
Aug 05 17:08:49.355276 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:08:49.355183    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="61c6770bb6ac095f3cc0075a831306b67e794a8dc96538ad29415a256e0993bd"
Aug 05 17:09:01.700334 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:01.700290    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:09:01.700913 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:01.700569    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" podUID="d23bb795-fe76-4f12-8a7e-089322d55fb0" containerName="payload-processing" containerID="cri-o://054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6" gracePeriod=30
Aug 05 17:09:01.879798 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:01.879224    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"]
Aug 05 17:09:01.888623 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:01.888590    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-f2130f-rh2kw"]
Aug 05 17:09:01.958225 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:01.958170    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:09:02.056482 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.056450    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume\") pod \"d23bb795-fe76-4f12-8a7e-089322d55fb0\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") "
Aug 05 17:09:02.056645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.056503    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrc2h\" (UniqueName: \"kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h\") pod \"d23bb795-fe76-4f12-8a7e-089322d55fb0\" (UID: \"d23bb795-fe76-4f12-8a7e-089322d55fb0\") "
Aug 05 17:09:02.056807 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.056787    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d23bb795-fe76-4f12-8a7e-089322d55fb0" (UID: "d23bb795-fe76-4f12-8a7e-089322d55fb0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:09:02.058621 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.058593    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h" (OuterVolumeSpecName: "kube-api-access-mrc2h") pod "d23bb795-fe76-4f12-8a7e-089322d55fb0" (UID: "d23bb795-fe76-4f12-8a7e-089322d55fb0"). InnerVolumeSpecName "kube-api-access-mrc2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:09:02.157418 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.157384    2546 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d23bb795-fe76-4f12-8a7e-089322d55fb0-plugins-config-volume\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.157418 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.157411    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrc2h\" (UniqueName: \"kubernetes.io/projected/d23bb795-fe76-4f12-8a7e-089322d55fb0-kube-api-access-mrc2h\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:09:02.310360 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.310254    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="383185fc-80d9-4795-a9c7-5cd145eacb8c" path="/var/lib/kubelet/pods/383185fc-80d9-4795-a9c7-5cd145eacb8c/volumes"
Aug 05 17:09:02.429432 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.429400    2546 generic.go:356] "Generic (PLEG): container finished" podID="d23bb795-fe76-4f12-8a7e-089322d55fb0" containerID="054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6" exitCode=0
Aug 05 17:09:02.429594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.429444    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"
Aug 05 17:09:02.429594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.429450    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" event={"ID":"d23bb795-fe76-4f12-8a7e-089322d55fb0","Type":"ContainerDied","Data":"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"}
Aug 05 17:09:02.429594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.429498    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8" event={"ID":"d23bb795-fe76-4f12-8a7e-089322d55fb0","Type":"ContainerDied","Data":"af19d1584c2749ead5a85ef038a2e40d4b6e6d5f62d18580ca44a9c5b784a0b4"}
Aug 05 17:09:02.429594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.429524    2546 scope.go:117] "RemoveContainer" containerID="054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"
Aug 05 17:09:02.438662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.438638    2546 scope.go:117] "RemoveContainer" containerID="054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"
Aug 05 17:09:02.438907 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:09:02.438887    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6\": container with ID starting with 054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6 not found: ID does not exist" containerID="054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"
Aug 05 17:09:02.438963 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.438918    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6"} err="failed to get container status \"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6\": rpc error: code = NotFound desc = could not find container \"054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6\": container with ID starting with 054599cae4e1239080c0d90999add3623c930c3717f839af4f144dab06705cd6 not found: ID does not exist"
Aug 05 17:09:02.448184 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.448160    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:09:02.453007 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:02.452985    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-f2130f-7cc98d4b7d-wmsj8"]
Aug 05 17:09:03.694096 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:03.694059    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:09:04.310372 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:04.310314    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d23bb795-fe76-4f12-8a7e-089322d55fb0" path="/var/lib/kubelet/pods/d23bb795-fe76-4f12-8a7e-089322d55fb0/volumes"
Aug 05 17:09:16.397833 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:16.397799    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:09:42.843454 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843417    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:09:42.843902 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843816    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d23bb795-fe76-4f12-8a7e-089322d55fb0" containerName="payload-processing"
Aug 05 17:09:42.843902 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843827    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="d23bb795-fe76-4f12-8a7e-089322d55fb0" containerName="payload-processing"
Aug 05 17:09:42.843902 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843841    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="383185fc-80d9-4795-a9c7-5cd145eacb8c" containerName="revoke-keys"
Aug 05 17:09:42.843902 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843847    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="383185fc-80d9-4795-a9c7-5cd145eacb8c" containerName="revoke-keys"
Aug 05 17:09:42.844035 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843906    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="d23bb795-fe76-4f12-8a7e-089322d55fb0" containerName="payload-processing"
Aug 05 17:09:42.844035 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.843915    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="383185fc-80d9-4795-a9c7-5cd145eacb8c" containerName="revoke-keys"
Aug 05 17:09:42.847025 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.847007    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:42.849631 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.849612    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-46e6bf\""
Aug 05 17:09:42.849750 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.849730    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-46e6bf-dockercfg-9vhcr\""
Aug 05 17:09:42.862551 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:42.862524    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:09:43.009959 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.009915    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76pd8\" (UniqueName: \"kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.010165 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.010007    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.111148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.111051    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76pd8\" (UniqueName: \"kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.111148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.111129    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.111855 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.111835    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.125639 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.125609    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76pd8\" (UniqueName: \"kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8\") pod \"payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.157463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.157427    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.301285 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.301247    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:09:43.303398 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:09:43.303369    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8de0fe84_1050_4af7_9abe_53c5e633ea0b.slice/crio-fc28c53edd89cc0a835ffa22e99c8e1a9143d8415888b66cabcebdb15b79d885 WatchSource:0}: Error finding container fc28c53edd89cc0a835ffa22e99c8e1a9143d8415888b66cabcebdb15b79d885: Status 404 returned error can't find the container with id fc28c53edd89cc0a835ffa22e99c8e1a9143d8415888b66cabcebdb15b79d885
Aug 05 17:09:43.663758 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.663674    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" event={"ID":"8de0fe84-1050-4af7-9abe-53c5e633ea0b","Type":"ContainerStarted","Data":"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"}
Aug 05 17:09:43.663758 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.663725    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" event={"ID":"8de0fe84-1050-4af7-9abe-53c5e633ea0b","Type":"ContainerStarted","Data":"fc28c53edd89cc0a835ffa22e99c8e1a9143d8415888b66cabcebdb15b79d885"}
Aug 05 17:09:43.663758 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.663754    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:09:43.687255 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:43.687207    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" podStartSLOduration=1.687194936 podStartE2EDuration="1.687194936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:09:43.684681203 +0000 UTC m=+2897.945991801" watchObservedRunningTime="2026-08-05 17:09:43.687194936 +0000 UTC m=+2897.948505535"
Aug 05 17:09:45.399847 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:45.399802    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:09:54.672228 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:09:54.672193    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:10:09.600344 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.600303    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:10:09.603911 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.603894    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.606300 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.606276    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"kube-root-ca.crt\""
Aug 05 17:10:09.607159 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.607140    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"openshift-service-ca.crt\""
Aug 05 17:10:09.607247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.607163    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"auth-test-model-02b433-kserve-self-signed-certs\""
Aug 05 17:10:09.607247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.607163    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"default-dockercfg-zjfgv\""
Aug 05 17:10:09.615956 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.615935    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:10:09.647276 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647247    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pws5\" (UniqueName: \"kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.647460 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647318    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.647460 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647401    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.647460 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647439    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.647632 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647466    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.647632 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.647557    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748151 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748117    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pws5\" (UniqueName: \"kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748169    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748199    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748219    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748236    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748259    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748661 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748642    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748762 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748738    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.748809 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.748768    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.750535 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.750515    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.750825 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.750807    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.758365 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.758305    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pws5\" (UniqueName: \"kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5\") pod \"auth-test-model-02b433-kserve-cf7cf867-x5bfp\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") " pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:09.913388 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:09.913295    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:10.062747 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:10.062719    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:10:10.065101 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:10:10.065070    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode9a69ab7_4646_4fb6_b5b3_29c4fbbc9b28.slice/crio-04280dd4bbfa89b59e388191ee8fb888084f963468d7ed2b1e8245e4c0102537 WatchSource:0}: Error finding container 04280dd4bbfa89b59e388191ee8fb888084f963468d7ed2b1e8245e4c0102537: Status 404 returned error can't find the container with id 04280dd4bbfa89b59e388191ee8fb888084f963468d7ed2b1e8245e4c0102537
Aug 05 17:10:10.815778 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:10.815744    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" event={"ID":"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28","Type":"ContainerStarted","Data":"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"}
Aug 05 17:10:10.816180 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:10.815790    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" event={"ID":"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28","Type":"ContainerStarted","Data":"04280dd4bbfa89b59e388191ee8fb888084f963468d7ed2b1e8245e4c0102537"}
Aug 05 17:10:10.836377 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:10.836301    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" podStartSLOduration=1.836285803 podStartE2EDuration="1.836285803s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:10:10.835468665 +0000 UTC m=+2925.096779264" watchObservedRunningTime="2026-08-05 17:10:10.836285803 +0000 UTC m=+2925.097596401"
Aug 05 17:10:11.902572 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:11.902535    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:10:19.914320 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:19.914284    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:19.914320 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:19.914342    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:19.927032 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:19.927007    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:20.882668 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:20.882638    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:10:41.493278 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:10:41.493244    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:11:06.302373 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:06.302280    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:11:22.292953 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:22.292919    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:11:26.491713 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:26.491683    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:11:26.502985 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:26.502959    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:11:32.709259 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:32.709223    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:11:47.916645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:47.916611    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:11:59.392819 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:11:59.392786    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:12:14.299724 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:12:14.299670    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:12:26.101757 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:12:26.101725    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:12:40.901130 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:12:40.901097    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:12:52.296342 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:12:52.296288    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:13:07.215492 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:07.215455    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:13:19.126935 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:19.126889    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:13:26.625861 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:26.625833    2546 scope.go:117] "RemoveContainer" containerID="7375e725f5393a212230a1c462a5b74e4a089f0e5536dd4fc7cbbd223114ce80"
Aug 05 17:13:26.634790 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:26.634770    2546 scope.go:117] "RemoveContainer" containerID="ec0b688bcca3d691d3bde64e1d1193af0f5ccc8b6cca42c353df43c9c8bd24d0"
Aug 05 17:13:33.695126 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:33.695085    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:13:38.039424 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:38.039388    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:13:43.801843 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:43.801811    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:13:53.058641 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.058524    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" podUID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" containerName="main" containerID="cri-o://0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2" gracePeriod=45
Aug 05 17:13:53.311719 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.311658    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:13:53.476601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476570    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pws5\" (UniqueName: \"kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.476601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476604    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.476845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476626    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.476845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476674    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.476845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476756    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.476845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476799    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir\") pod \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\" (UID: \"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28\") "
Aug 05 17:13:53.477069 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.476939    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home" (OuterVolumeSpecName: "home") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:53.477134 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.477080    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache" (OuterVolumeSpecName: "model-cache") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:53.477134 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.477101    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:53.477249 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.477190    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-home\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:53.477249 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.477203    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-model-cache\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:53.477249 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.477215    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tmp-dir\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:53.478949 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.478918    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm" (OuterVolumeSpecName: "dshm") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:13:53.478949 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.478924    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:13:53.479094 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.478973    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5" (OuterVolumeSpecName: "kube-api-access-6pws5") pod "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" (UID: "e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28"). InnerVolumeSpecName "kube-api-access-6pws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:13:53.578045 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.577955    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pws5\" (UniqueName: \"kubernetes.io/projected/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-kube-api-access-6pws5\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:53.578045 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.577989    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-tls-certs\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:53.578045 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:53.577998    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28-dshm\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:13:54.097383 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.097312    2546 generic.go:356] "Generic (PLEG): container finished" podID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" containerID="0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2" exitCode=0
Aug 05 17:13:54.097383 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.097375    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"
Aug 05 17:13:54.097383 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.097379    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" event={"ID":"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28","Type":"ContainerDied","Data":"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"}
Aug 05 17:13:54.097963 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.097412    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp" event={"ID":"e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28","Type":"ContainerDied","Data":"04280dd4bbfa89b59e388191ee8fb888084f963468d7ed2b1e8245e4c0102537"}
Aug 05 17:13:54.097963 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.097428    2546 scope.go:117] "RemoveContainer" containerID="0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"
Aug 05 17:13:54.106674 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.106655    2546 scope.go:117] "RemoveContainer" containerID="0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"
Aug 05 17:13:54.106916 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:13:54.106895    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2\": container with ID starting with 0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2 not found: ID does not exist" containerID="0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"
Aug 05 17:13:54.106968 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.106924    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2"} err="failed to get container status \"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2\": rpc error: code = NotFound desc = could not find container \"0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2\": container with ID starting with 0ee660ab01105712ad0b4a221b9c9fb7684f5517d291dddbe63c8439d8b6b8e2 not found: ID does not exist"
Aug 05 17:13:54.120701 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.120673    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:13:54.127373 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.127349    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/auth-test-model-02b433-kserve-cf7cf867-x5bfp"]
Aug 05 17:13:54.311367 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:54.311316    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" path="/var/lib/kubelet/pods/e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28/volumes"
Aug 05 17:13:59.493732 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.493699    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:13:59.494108 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.494096    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" containerName="main"
Aug 05 17:13:59.494155 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.494110    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" containerName="main"
Aug 05 17:13:59.494199 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.494191    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9a69ab7-4646-4fb6-b5b3-29c4fbbc9b28" containerName="main"
Aug 05 17:13:59.498550 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.498530    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.502071 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.502048    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"default-dockercfg-zjfgv\""
Aug 05 17:13:59.502071 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.502065    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"kube-root-ca.crt\""
Aug 05 17:13:59.502262 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.502048    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"openshift-service-ca.crt\""
Aug 05 17:13:59.502262 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.502057    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"sub-test-model-02b433-kserve-self-signed-certs\""
Aug 05 17:13:59.507423 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.507399    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:13:59.635360 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635302    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.635527 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635405    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.635527 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635452    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.635527 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635482    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.635638 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635545    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.635638 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.635609    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r526s\" (UniqueName: \"kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736374 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736317    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736389    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736414    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736546 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736457    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736735 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736556    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r526s\" (UniqueName: \"kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736735 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736618    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736839 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736788    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736979 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736843    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.736979 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.736860    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.738894 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.738858    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.739073 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.739049    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.746084 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.746007    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r526s\" (UniqueName: \"kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s\") pod \"sub-test-model-02b433-kserve-5685569f47-d4mc6\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") " pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.808476 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.808436    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:13:59.959301 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:13:59.959270    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:13:59.960634 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:13:59.960604    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6e96389e_bf47_4e95_a209_0b58054d6bbc.slice/crio-a136c4edf4b92a11ee3dfd5b1d5ddc1f9a06eb1b65adb8fd3716149cf4f097ff WatchSource:0}: Error finding container a136c4edf4b92a11ee3dfd5b1d5ddc1f9a06eb1b65adb8fd3716149cf4f097ff: Status 404 returned error can't find the container with id a136c4edf4b92a11ee3dfd5b1d5ddc1f9a06eb1b65adb8fd3716149cf4f097ff
Aug 05 17:14:00.135402 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:00.135364    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" event={"ID":"6e96389e-bf47-4e95-a209-0b58054d6bbc","Type":"ContainerStarted","Data":"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"}
Aug 05 17:14:00.135402 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:00.135409    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" event={"ID":"6e96389e-bf47-4e95-a209-0b58054d6bbc","Type":"ContainerStarted","Data":"a136c4edf4b92a11ee3dfd5b1d5ddc1f9a06eb1b65adb8fd3716149cf4f097ff"}
Aug 05 17:14:00.160451 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:00.160399    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" podStartSLOduration=1.160378798 podStartE2EDuration="1.160378798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:13:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:14:00.159202832 +0000 UTC m=+3154.420513442" watchObservedRunningTime="2026-08-05 17:14:00.160378798 +0000 UTC m=+3154.421689395"
Aug 05 17:14:01.911163 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:01.911130    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:14:09.808950 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:09.808907    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:14:09.809458 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:09.808969    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:14:09.821767 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:09.821735    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:14:10.211841 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:10.211809    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:14:20.892081 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:20.892043    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:14:26.663399 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:26.663368    2546 scope.go:117] "RemoveContainer" containerID="4c537209425b8c96b6d4338b10ece839135004bcebc3413a8d2fdaf14d06de48"
Aug 05 17:14:56.605993 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:14:56.605953    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:15:00.129624 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.129590    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"]
Aug 05 17:15:00.133260 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.133238    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"
Aug 05 17:15:00.133406 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.133388    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"]
Aug 05 17:15:00.136880 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.136861    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"]
Aug 05 17:15:00.136993 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.136923    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:15:00.136993 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.136949    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"
Aug 05 17:15:00.140311 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.140289    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"
Aug 05 17:15:00.143136 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.143115    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"]
Aug 05 17:15:00.145796 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.145779    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"
Aug 05 17:15:00.148002 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.147984    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"]
Aug 05 17:15:00.152995 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.150995    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"]
Aug 05 17:15:00.158429 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.158306    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"
Aug 05 17:15:00.197517 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.197362    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"
Aug 05 17:15:00.317175 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.317139    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"]
Aug 05 17:15:00.319443 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:15:00.319412    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d93189_ebe9_4009_9f2b_0cb8c3e91db0.slice/crio-c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541 WatchSource:0}: Error finding container c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541: Status 404 returned error can't find the container with id c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541
Aug 05 17:15:00.376885 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.376860    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"]
Aug 05 17:15:00.379169 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:15:00.379136    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc127b2_0a87_4ce9_a267_81abfecef3ff.slice/crio-0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72 WatchSource:0}: Error finding container 0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72: Status 404 returned error can't find the container with id 0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72
Aug 05 17:15:00.480593 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.480554    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk" event={"ID":"39d93189-ebe9-4009-9f2b-0cb8c3e91db0","Type":"ContainerStarted","Data":"c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541"}
Aug 05 17:15:00.481709 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.481682    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct" event={"ID":"6cc127b2-0a87-4ce9-a267-81abfecef3ff","Type":"ContainerStarted","Data":"0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72"}
Aug 05 17:15:00.556189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:00.556167    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"]
Aug 05 17:15:00.558078 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:15:00.558056    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc994c252_4865_4c38_8fae_d78a488780f3.slice/crio-669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a WatchSource:0}: Error finding container 669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a: Status 404 returned error can't find the container with id 669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a
Aug 05 17:15:01.489285 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.489183    2546 generic.go:356] "Generic (PLEG): container finished" podID="39d93189-ebe9-4009-9f2b-0cb8c3e91db0" containerID="f63ffafc79f11f64f74feb66b3e597c24f3cde05d58cc396ebcee88fc7f75cd0" exitCode=0
Aug 05 17:15:01.489681 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.489279    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk" event={"ID":"39d93189-ebe9-4009-9f2b-0cb8c3e91db0","Type":"ContainerDied","Data":"f63ffafc79f11f64f74feb66b3e597c24f3cde05d58cc396ebcee88fc7f75cd0"}
Aug 05 17:15:01.490751 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.490726    2546 generic.go:356] "Generic (PLEG): container finished" podID="6cc127b2-0a87-4ce9-a267-81abfecef3ff" containerID="f8aeb390d3e3ed25953063e0465957ef7b75d29a8a8b33c73a0d3a1bcf08be05" exitCode=0
Aug 05 17:15:01.490836 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.490808    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct" event={"ID":"6cc127b2-0a87-4ce9-a267-81abfecef3ff","Type":"ContainerDied","Data":"f8aeb390d3e3ed25953063e0465957ef7b75d29a8a8b33c73a0d3a1bcf08be05"}
Aug 05 17:15:01.492182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.492159    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr" event={"ID":"c994c252-4865-4c38-8fae-d78a488780f3","Type":"ContainerStarted","Data":"6b1bd8e6ef3e66cfd9cc25692e797845ace02e901f59fafdd79a69ba57c25b3d"}
Aug 05 17:15:01.492311 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.492196    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr" event={"ID":"c994c252-4865-4c38-8fae-d78a488780f3","Type":"ContainerStarted","Data":"669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a"}
Aug 05 17:15:01.520610 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:01.520569    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr" podStartSLOduration=1.52055577 podStartE2EDuration="1.52055577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:01.520194871 +0000 UTC m=+3215.781505470" watchObservedRunningTime="2026-08-05 17:15:01.52055577 +0000 UTC m=+3215.781866368"
Aug 05 17:15:02.499463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:02.499427    2546 generic.go:356] "Generic (PLEG): container finished" podID="c994c252-4865-4c38-8fae-d78a488780f3" containerID="6b1bd8e6ef3e66cfd9cc25692e797845ace02e901f59fafdd79a69ba57c25b3d" exitCode=0
Aug 05 17:15:02.499902 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:02.499517    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr" event={"ID":"c994c252-4865-4c38-8fae-d78a488780f3","Type":"ContainerDied","Data":"6b1bd8e6ef3e66cfd9cc25692e797845ace02e901f59fafdd79a69ba57c25b3d"}
Aug 05 17:15:02.632267 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:02.632232    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"
Aug 05 17:15:02.661645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:02.661619    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"
Aug 05 17:15:03.506066 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.506038    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"
Aug 05 17:15:03.506066 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.506055    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk" event={"ID":"39d93189-ebe9-4009-9f2b-0cb8c3e91db0","Type":"ContainerDied","Data":"c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541"}
Aug 05 17:15:03.506608 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.506100    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7c7a3a487cda9131a254430c58fc6046b4e667fd580d4af21debf02447ea541"
Aug 05 17:15:03.507496 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.507472    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"
Aug 05 17:15:03.507585 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.507516    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct" event={"ID":"6cc127b2-0a87-4ce9-a267-81abfecef3ff","Type":"ContainerDied","Data":"0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72"}
Aug 05 17:15:03.507585 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.507564    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0ab8b90b6131151eb27204fabde9610edf7750f8edfecafb6492e67ed3a8db72"
Aug 05 17:15:03.647213 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:03.647190    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"
Aug 05 17:15:04.515525 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:04.515488    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr" event={"ID":"c994c252-4865-4c38-8fae-d78a488780f3","Type":"ContainerDied","Data":"669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a"}
Aug 05 17:15:04.515525 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:04.515520    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29765835-2shkr"
Aug 05 17:15:04.515979 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:04.515544    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="669241c2289ddc59b5ee299b136506a42334dd38ea6d2a7eec1a65dcb2c0286a"
Aug 05 17:15:08.785940 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:08.785907    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:15:19.619049 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:19.618961    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:15:24.236876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:24.236828    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:15:26.688998 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:26.688967    2546 scope.go:117] "RemoveContainer" containerID="7115d1a861f592568e0c6ca5dc20552680830ed497a93daadffa379566a2a78a"
Aug 05 17:15:30.495548 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:30.495514    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:15:39.255933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.255894    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" podUID="6e96389e-bf47-4e95-a209-0b58054d6bbc" containerName="main" containerID="cri-o://9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d" gracePeriod=45
Aug 05 17:15:39.508838 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.508778    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:15:39.562976 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.562944    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r526s\" (UniqueName: \"kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.562991    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563039    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563063    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563080    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563148 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563127    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home\") pod \"6e96389e-bf47-4e95-a209-0b58054d6bbc\" (UID: \"6e96389e-bf47-4e95-a209-0b58054d6bbc\") "
Aug 05 17:15:39.563465 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563240    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache" (OuterVolumeSpecName: "model-cache") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:15:39.563465 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563349    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:15:39.563588 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563501    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home" (OuterVolumeSpecName: "home") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:15:39.563588 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563506    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-model-cache\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.563588 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.563538    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-tmp-dir\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.565224 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.565198    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm" (OuterVolumeSpecName: "dshm") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:15:39.565612 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.565574    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s" (OuterVolumeSpecName: "kube-api-access-r526s") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "kube-api-access-r526s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:15:39.565722 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.565651    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6e96389e-bf47-4e95-a209-0b58054d6bbc" (UID: "6e96389e-bf47-4e95-a209-0b58054d6bbc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:15:39.664626 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.664589    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r526s\" (UniqueName: \"kubernetes.io/projected/6e96389e-bf47-4e95-a209-0b58054d6bbc-kube-api-access-r526s\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.664626 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.664620    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-dshm\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.664626 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.664632    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e96389e-bf47-4e95-a209-0b58054d6bbc-tls-certs\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.664861 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.664640    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6e96389e-bf47-4e95-a209-0b58054d6bbc-home\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:15:39.714023 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.713991    2546 generic.go:356] "Generic (PLEG): container finished" podID="6e96389e-bf47-4e95-a209-0b58054d6bbc" containerID="9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d" exitCode=0
Aug 05 17:15:39.714194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.714032    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"
Aug 05 17:15:39.714194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.714078    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" event={"ID":"6e96389e-bf47-4e95-a209-0b58054d6bbc","Type":"ContainerDied","Data":"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"}
Aug 05 17:15:39.714194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.714118    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6" event={"ID":"6e96389e-bf47-4e95-a209-0b58054d6bbc","Type":"ContainerDied","Data":"a136c4edf4b92a11ee3dfd5b1d5ddc1f9a06eb1b65adb8fd3716149cf4f097ff"}
Aug 05 17:15:39.714194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.714136    2546 scope.go:117] "RemoveContainer" containerID="9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"
Aug 05 17:15:39.723606 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.723587    2546 scope.go:117] "RemoveContainer" containerID="9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"
Aug 05 17:15:39.723845 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:15:39.723826    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d\": container with ID starting with 9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d not found: ID does not exist" containerID="9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"
Aug 05 17:15:39.723921 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.723855    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d"} err="failed to get container status \"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d\": rpc error: code = NotFound desc = could not find container \"9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d\": container with ID starting with 9bbb0b0987fcca4f1afef398d6760ba8cb385fba465b796794be5e715aba401d not found: ID does not exist"
Aug 05 17:15:39.737901 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.737878    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:15:39.745649 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:39.745629    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/sub-test-model-02b433-kserve-5685569f47-d4mc6"]
Aug 05 17:15:40.310436 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.310396    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e96389e-bf47-4e95-a209-0b58054d6bbc" path="/var/lib/kubelet/pods/6e96389e-bf47-4e95-a209-0b58054d6bbc/volumes"
Aug 05 17:15:40.598618 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.598587    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:15:40.598992 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.598980    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cc127b2-0a87-4ce9-a267-81abfecef3ff" containerName="cleanup"
Aug 05 17:15:40.599036 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.598994    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cc127b2-0a87-4ce9-a267-81abfecef3ff" containerName="cleanup"
Aug 05 17:15:40.599036 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599005    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c994c252-4865-4c38-8fae-d78a488780f3" containerName="cleanup"
Aug 05 17:15:40.599036 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599011    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="c994c252-4865-4c38-8fae-d78a488780f3" containerName="cleanup"
Aug 05 17:15:40.599036 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599023    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e96389e-bf47-4e95-a209-0b58054d6bbc" containerName="main"
Aug 05 17:15:40.599036 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599028    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e96389e-bf47-4e95-a209-0b58054d6bbc" containerName="main"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599040    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39d93189-ebe9-4009-9f2b-0cb8c3e91db0" containerName="cleanup"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599047    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="39d93189-ebe9-4009-9f2b-0cb8c3e91db0" containerName="cleanup"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599109    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="39d93189-ebe9-4009-9f2b-0cb8c3e91db0" containerName="cleanup"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599117    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e96389e-bf47-4e95-a209-0b58054d6bbc" containerName="main"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599123    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cc127b2-0a87-4ce9-a267-81abfecef3ff" containerName="cleanup"
Aug 05 17:15:40.599188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.599128    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="c994c252-4865-4c38-8fae-d78a488780f3" containerName="cleanup"
Aug 05 17:15:40.603753 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.603737    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.608066 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.608037    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"kube-root-ca.crt\""
Aug 05 17:15:40.608246 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.608036    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"default-dockercfg-zjfgv\""
Aug 05 17:15:40.608246 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.608036    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"rate-test-model-02b433-kserve-self-signed-certs\""
Aug 05 17:15:40.608246 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.608036    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-02b433\"/\"openshift-service-ca.crt\""
Aug 05 17:15:40.611542 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.611519    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:15:40.671202 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671168    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.671202 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671204    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.671453 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671222    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.671453 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671291    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.671453 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671382    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvl6h\" (UniqueName: \"kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.671453 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.671444    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.771895 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.771863    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772089 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.771910    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvl6h\" (UniqueName: \"kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772089 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.771949    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772089 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.771972    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772089 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.771987    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772089 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.772003    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772431 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.772318    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772431 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.772369    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.772431 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.772400    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.774229 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.774209    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.774570 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.774552    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.780117 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.780096    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvl6h\" (UniqueName: \"kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h\") pod \"rate-test-model-02b433-kserve-64bcbccf47-xpnzh\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") " pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:40.913898 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:40.913806    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:41.062040 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:41.062007    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:15:41.062915 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:15:41.062891    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2fd280bc_43c4_4bf9_8c46_144186fa1691.slice/crio-1470c7da6b20162e2069925e93b9b822cb8abd18a470b21de9da109420dacb2d WatchSource:0}: Error finding container 1470c7da6b20162e2069925e93b9b822cb8abd18a470b21de9da109420dacb2d: Status 404 returned error can't find the container with id 1470c7da6b20162e2069925e93b9b822cb8abd18a470b21de9da109420dacb2d
Aug 05 17:15:41.730787 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:41.730751    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" event={"ID":"2fd280bc-43c4-4bf9-8c46-144186fa1691","Type":"ContainerStarted","Data":"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"}
Aug 05 17:15:41.731180 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:41.730797    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" event={"ID":"2fd280bc-43c4-4bf9-8c46-144186fa1691","Type":"ContainerStarted","Data":"1470c7da6b20162e2069925e93b9b822cb8abd18a470b21de9da109420dacb2d"}
Aug 05 17:15:41.759285 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:41.759238    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" podStartSLOduration=1.759222194 podStartE2EDuration="1.759222194s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:15:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:15:41.756866389 +0000 UTC m=+3256.018176987" watchObservedRunningTime="2026-08-05 17:15:41.759222194 +0000 UTC m=+3256.020532792"
Aug 05 17:15:43.115165 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:43.115132    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:15:50.914099 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:50.914064    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:50.914538 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:50.914260    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:50.926822 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:50.926796    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:15:51.801752 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:15:51.801718    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:16:03.399778 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:16:03.399741    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:16:26.529634 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:16:26.529606    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:16:26.541961 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:16:26.541932    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:16:47.331297 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:16:47.331263    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:17:00.730263 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:00.730185    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:17:11.329601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:11.329571    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:17:17.285703 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:17.285672    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:17:19.045449 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.045414    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139681450516272"]
Aug 05 17:17:19.049157 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.049139    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:19.052132 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.052111    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vwmvl\""
Aug 05 17:17:19.057909 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.057887    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450516272"]
Aug 05 17:17:19.067169 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.067144    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhbt7\" (UniqueName: \"kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7\") pod \"test-curl-7497-139681450516272\" (UID: \"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6\") " pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:19.168435 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.168404    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhbt7\" (UniqueName: \"kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7\") pod \"test-curl-7497-139681450516272\" (UID: \"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6\") " pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:19.176935 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.176904    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhbt7\" (UniqueName: \"kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7\") pod \"test-curl-7497-139681450516272\" (UID: \"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6\") " pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:19.360443 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.360414    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:19.498104 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.498079    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450516272"]
Aug 05 17:17:19.499410 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:19.499383    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4ba7976b_8a47_4b2c_8e4c_525bc87b88d6.slice/crio-08f0cb0a71e43b8dc7738cc139716b3932a449505db4ee81bfbbd9f3e8f961ec WatchSource:0}: Error finding container 08f0cb0a71e43b8dc7738cc139716b3932a449505db4ee81bfbbd9f3e8f961ec: Status 404 returned error can't find the container with id 08f0cb0a71e43b8dc7738cc139716b3932a449505db4ee81bfbbd9f3e8f961ec
Aug 05 17:17:19.500646 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:19.500617    2546 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Aug 05 17:17:20.295652 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:20.295619    2546 generic.go:356] "Generic (PLEG): container finished" podID="4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" containerID="892562fd1384f832494a72e849395b44871d45075cd945e2ef0def3ab345ce20" exitCode=0
Aug 05 17:17:20.295983 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:20.295702    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450516272" event={"ID":"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6","Type":"ContainerDied","Data":"892562fd1384f832494a72e849395b44871d45075cd945e2ef0def3ab345ce20"}
Aug 05 17:17:20.295983 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:20.295752    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450516272" event={"ID":"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6","Type":"ContainerStarted","Data":"08f0cb0a71e43b8dc7738cc139716b3932a449505db4ee81bfbbd9f3e8f961ec"}
Aug 05 17:17:21.434215 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.434189    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:21.470794 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.470762    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139681450516272_4ba7976b-8a47-4b2c-8e4c-525bc87b88d6/test-curl-7497-139681450516272/0.log"
Aug 05 17:17:21.486977 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.486949    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mhbt7\" (UniqueName: \"kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7\") pod \"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6\" (UID: \"4ba7976b-8a47-4b2c-8e4c-525bc87b88d6\") "
Aug 05 17:17:21.489085 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.489062    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7" (OuterVolumeSpecName: "kube-api-access-mhbt7") pod "4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" (UID: "4ba7976b-8a47-4b2c-8e4c-525bc87b88d6"). InnerVolumeSpecName "kube-api-access-mhbt7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:21.492891 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.492867    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139681450516272"]
Aug 05 17:17:21.496728 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.496710    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139681450516272"]
Aug 05 17:17:21.588043 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:21.588014    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mhbt7\" (UniqueName: \"kubernetes.io/projected/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6-kube-api-access-mhbt7\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:22.308231 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:22.308205    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450516272"
Aug 05 17:17:22.310559 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:22.310527    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" path="/var/lib/kubelet/pods/4ba7976b-8a47-4b2c-8e4c-525bc87b88d6/volumes"
Aug 05 17:17:22.310874 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:22.310863    2546 scope.go:117] "RemoveContainer" containerID="892562fd1384f832494a72e849395b44871d45075cd945e2ef0def3ab345ce20"
Aug 05 17:17:23.202761 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:23.202730    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:17:24.659991 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.659953    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:24.660413 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.660363    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" containerName="test-curl-7497-139681450516272"
Aug 05 17:17:24.660413 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.660378    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" containerName="test-curl-7497-139681450516272"
Aug 05 17:17:24.660498 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.660471    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ba7976b-8a47-4b2c-8e4c-525bc87b88d6" containerName="test-curl-7497-139681450516272"
Aug 05 17:17:24.665013 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.664998    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:24.667940 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.667922    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vwmvl\""
Aug 05 17:17:24.673106 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.673078    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:24.714833 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.714804    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfrlh\" (UniqueName: \"kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh\") pod \"test-curl-7497-139681450537872\" (UID: \"73c591fc-2af9-4e14-a922-653b8c3375f9\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:24.815243 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.815218    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfrlh\" (UniqueName: \"kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh\") pod \"test-curl-7497-139681450537872\" (UID: \"73c591fc-2af9-4e14-a922-653b8c3375f9\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:24.825127 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.825100    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfrlh\" (UniqueName: \"kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh\") pod \"test-curl-7497-139681450537872\" (UID: \"73c591fc-2af9-4e14-a922-653b8c3375f9\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:24.975295 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:24.975213    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:25.130644 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:25.130617    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73c591fc_2af9_4e14_a922_653b8c3375f9.slice/crio-d7f5b887e8f1f5d12062b05dcb7deff61067536ed549ecd0586b4b6f10901912 WatchSource:0}: Error finding container d7f5b887e8f1f5d12062b05dcb7deff61067536ed549ecd0586b4b6f10901912: Status 404 returned error can't find the container with id d7f5b887e8f1f5d12062b05dcb7deff61067536ed549ecd0586b4b6f10901912
Aug 05 17:17:25.132296 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:25.132276    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:25.327311 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:25.327220    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450537872" event={"ID":"73c591fc-2af9-4e14-a922-653b8c3375f9","Type":"ContainerStarted","Data":"d7f5b887e8f1f5d12062b05dcb7deff61067536ed549ecd0586b4b6f10901912"}
Aug 05 17:17:26.334392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:26.334355    2546 generic.go:356] "Generic (PLEG): container finished" podID="73c591fc-2af9-4e14-a922-653b8c3375f9" containerID="27d990406aa3107b4f4dcaab22fdea43277917e034f38233016a6f40bf737b33" exitCode=0
Aug 05 17:17:26.334772 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:26.334438    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450537872" event={"ID":"73c591fc-2af9-4e14-a922-653b8c3375f9","Type":"ContainerDied","Data":"27d990406aa3107b4f4dcaab22fdea43277917e034f38233016a6f40bf737b33"}
Aug 05 17:17:27.484964 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.484939    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:27.504589 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.504560    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139681450537872_73c591fc-2af9-4e14-a922-653b8c3375f9/test-curl-7497-139681450537872/0.log"
Aug 05 17:17:27.525955 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.525921    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:27.531392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.531371    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:27.539059 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.539042    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfrlh\" (UniqueName: \"kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh\") pod \"73c591fc-2af9-4e14-a922-653b8c3375f9\" (UID: \"73c591fc-2af9-4e14-a922-653b8c3375f9\") "
Aug 05 17:17:27.541057 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.541027    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh" (OuterVolumeSpecName: "kube-api-access-sfrlh") pod "73c591fc-2af9-4e14-a922-653b8c3375f9" (UID: "73c591fc-2af9-4e14-a922-653b8c3375f9"). InnerVolumeSpecName "kube-api-access-sfrlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:27.640568 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.640492    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfrlh\" (UniqueName: \"kubernetes.io/projected/73c591fc-2af9-4e14-a922-653b8c3375f9-kube-api-access-sfrlh\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:27.650052 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.650021    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:27.650459 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.650435    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73c591fc-2af9-4e14-a922-653b8c3375f9" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:27.650459 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.650461    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="73c591fc-2af9-4e14-a922-653b8c3375f9" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:27.650549 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.650521    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="73c591fc-2af9-4e14-a922-653b8c3375f9" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:27.653598 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.653583    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:27.662035 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.662012    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:27.741678 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.741641    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wswqj\" (UniqueName: \"kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj\") pod \"test-curl-7497-139681450537872\" (UID: \"bbb8dea2-3395-419c-8169-1c333373299a\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:27.842932 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.842897    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wswqj\" (UniqueName: \"kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj\") pod \"test-curl-7497-139681450537872\" (UID: \"bbb8dea2-3395-419c-8169-1c333373299a\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:27.853478 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.853448    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wswqj\" (UniqueName: \"kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj\") pod \"test-curl-7497-139681450537872\" (UID: \"bbb8dea2-3395-419c-8169-1c333373299a\") " pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:27.963313 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:27.963229    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:28.096407 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:28.096383    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:28.097399 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:28.097371    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbb8dea2_3395_419c_8169_1c333373299a.slice/crio-a34738e6f5ef2ae038a0475667027c2338e2f0ad4d71f409f36179be7f112ce5 WatchSource:0}: Error finding container a34738e6f5ef2ae038a0475667027c2338e2f0ad4d71f409f36179be7f112ce5: Status 404 returned error can't find the container with id a34738e6f5ef2ae038a0475667027c2338e2f0ad4d71f409f36179be7f112ce5
Aug 05 17:17:28.311890 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:28.311806    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73c591fc-2af9-4e14-a922-653b8c3375f9" path="/var/lib/kubelet/pods/73c591fc-2af9-4e14-a922-653b8c3375f9/volumes"
Aug 05 17:17:28.347234 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:28.347208    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:28.347392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:28.347253    2546 scope.go:117] "RemoveContainer" containerID="27d990406aa3107b4f4dcaab22fdea43277917e034f38233016a6f40bf737b33"
Aug 05 17:17:28.348560 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:28.348537    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450537872" event={"ID":"bbb8dea2-3395-419c-8169-1c333373299a","Type":"ContainerStarted","Data":"a34738e6f5ef2ae038a0475667027c2338e2f0ad4d71f409f36179be7f112ce5"}
Aug 05 17:17:29.355823 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:29.355789    2546 generic.go:356] "Generic (PLEG): container finished" podID="bbb8dea2-3395-419c-8169-1c333373299a" containerID="4ff26fd4dea5fd54d4fdf7fdbe3d290f428c995e55d70263dc8ea6914120820b" exitCode=0
Aug 05 17:17:29.356209 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:29.355868    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450537872" event={"ID":"bbb8dea2-3395-419c-8169-1c333373299a","Type":"ContainerDied","Data":"4ff26fd4dea5fd54d4fdf7fdbe3d290f428c995e55d70263dc8ea6914120820b"}
Aug 05 17:17:30.501758 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.501735    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:30.524533 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.524502    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139681450537872_bbb8dea2-3395-419c-8169-1c333373299a/test-curl-7497-139681450537872/0.log"
Aug 05 17:17:30.551067 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.551038    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:30.555548 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.555525    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139681450537872"]
Aug 05 17:17:30.564261 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.564237    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wswqj\" (UniqueName: \"kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj\") pod \"bbb8dea2-3395-419c-8169-1c333373299a\" (UID: \"bbb8dea2-3395-419c-8169-1c333373299a\") "
Aug 05 17:17:30.566253 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.566232    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj" (OuterVolumeSpecName: "kube-api-access-wswqj") pod "bbb8dea2-3395-419c-8169-1c333373299a" (UID: "bbb8dea2-3395-419c-8169-1c333373299a"). InnerVolumeSpecName "kube-api-access-wswqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:30.665486 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:30.665423    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wswqj\" (UniqueName: \"kubernetes.io/projected/bbb8dea2-3395-419c-8169-1c333373299a-kube-api-access-wswqj\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:31.370610 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:31.370580    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:31.370792 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:31.370621    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a34738e6f5ef2ae038a0475667027c2338e2f0ad4d71f409f36179be7f112ce5"
Aug 05 17:17:31.380866 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:17:31.380835    2546 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7497-139681450537872\" is forbidden: User \"system:node:ip-10-0-134-153.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-153.ec2.internal' and this object" podUID="bbb8dea2-3395-419c-8169-1c333373299a" pod="opendatahub/test-curl-7497-139681450537872"
Aug 05 17:17:32.304279 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.304234    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" podUID="2fd280bc-43c4-4bf9-8c46-144186fa1691" containerName="main" containerID="cri-o://e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b" gracePeriod=45
Aug 05 17:17:32.310946 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.310919    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbb8dea2-3395-419c-8169-1c333373299a" path="/var/lib/kubelet/pods/bbb8dea2-3395-419c-8169-1c333373299a/volumes"
Aug 05 17:17:32.557410 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.557352    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:17:32.582977 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.582943    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.583103 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.582996    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.583103 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.583028    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.583103 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.583052    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.583103 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.583092    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cvl6h\" (UniqueName: \"kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.583318 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.583177    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm\") pod \"2fd280bc-43c4-4bf9-8c46-144186fa1691\" (UID: \"2fd280bc-43c4-4bf9-8c46-144186fa1691\") "
Aug 05 17:17:32.584042 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.583922    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home" (OuterVolumeSpecName: "home") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:17:32.584154 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.584055    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:17:32.584314 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.584282    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache" (OuterVolumeSpecName: "model-cache") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:17:32.586049 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.586022    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm" (OuterVolumeSpecName: "dshm") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:17:32.586183 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.586164    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h" (OuterVolumeSpecName: "kube-api-access-cvl6h") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "kube-api-access-cvl6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:32.586278 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.586256    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2fd280bc-43c4-4bf9-8c46-144186fa1691" (UID: "2fd280bc-43c4-4bf9-8c46-144186fa1691"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:17:32.684189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684158    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-dshm\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:32.684189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684183    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2fd280bc-43c4-4bf9-8c46-144186fa1691-tls-certs\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:32.684189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684193    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-model-cache\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:32.684189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684200    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-home\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:32.684463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684210    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2fd280bc-43c4-4bf9-8c46-144186fa1691-tmp-dir\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:32.684463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:32.684219    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cvl6h\" (UniqueName: \"kubernetes.io/projected/2fd280bc-43c4-4bf9-8c46-144186fa1691-kube-api-access-cvl6h\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:33.307558 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307524    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7497-139681450538880"]
Aug 05 17:17:33.307933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307895    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbb8dea2-3395-419c-8169-1c333373299a" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:33.307933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307906    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbb8dea2-3395-419c-8169-1c333373299a" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:33.307933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307920    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fd280bc-43c4-4bf9-8c46-144186fa1691" containerName="main"
Aug 05 17:17:33.307933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307925    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fd280bc-43c4-4bf9-8c46-144186fa1691" containerName="main"
Aug 05 17:17:33.308067 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.307997    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fd280bc-43c4-4bf9-8c46-144186fa1691" containerName="main"
Aug 05 17:17:33.308067 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.308005    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbb8dea2-3395-419c-8169-1c333373299a" containerName="test-curl-7497-139681450537872"
Aug 05 17:17:33.311149 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.311133    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:33.314401 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.314380    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vwmvl\""
Aug 05 17:17:33.324007 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.323982    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450538880"]
Aug 05 17:17:33.383110 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.383081    2546 generic.go:356] "Generic (PLEG): container finished" podID="2fd280bc-43c4-4bf9-8c46-144186fa1691" containerID="e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b" exitCode=0
Aug 05 17:17:33.383247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.383121    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"
Aug 05 17:17:33.383247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.383157    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" event={"ID":"2fd280bc-43c4-4bf9-8c46-144186fa1691","Type":"ContainerDied","Data":"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"}
Aug 05 17:17:33.383247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.383194    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh" event={"ID":"2fd280bc-43c4-4bf9-8c46-144186fa1691","Type":"ContainerDied","Data":"1470c7da6b20162e2069925e93b9b822cb8abd18a470b21de9da109420dacb2d"}
Aug 05 17:17:33.383247 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.383213    2546 scope.go:117] "RemoveContainer" containerID="e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"
Aug 05 17:17:33.390003 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.389982    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw4pb\" (UniqueName: \"kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb\") pod \"test-curl-7497-139681450538880\" (UID: \"cbbc2e3c-1799-4675-95fa-b74a39103c40\") " pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:33.393102 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.393086    2546 scope.go:117] "RemoveContainer" containerID="e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"
Aug 05 17:17:33.393355 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:17:33.393334    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b\": container with ID starting with e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b not found: ID does not exist" containerID="e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"
Aug 05 17:17:33.393402 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.393363    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b"} err="failed to get container status \"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b\": rpc error: code = NotFound desc = could not find container \"e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b\": container with ID starting with e9839a9b7afb605af71682581cb74c630005eeb592b6208e11aabc9db6659c1b not found: ID does not exist"
Aug 05 17:17:33.407778 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.407750    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:17:33.412312 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.412292    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-02b433/rate-test-model-02b433-kserve-64bcbccf47-xpnzh"]
Aug 05 17:17:33.491108 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.491078    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw4pb\" (UniqueName: \"kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb\") pod \"test-curl-7497-139681450538880\" (UID: \"cbbc2e3c-1799-4675-95fa-b74a39103c40\") " pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:33.501404 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.501373    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw4pb\" (UniqueName: \"kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb\") pod \"test-curl-7497-139681450538880\" (UID: \"cbbc2e3c-1799-4675-95fa-b74a39103c40\") " pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:33.620168 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.620140    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:33.753887 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:33.753857    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7497-139681450538880"]
Aug 05 17:17:33.754968 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:33.754936    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbbc2e3c_1799_4675_95fa_b74a39103c40.slice/crio-e688df4af3213731889e804e344bcf4d23290c3fa152d27b4eaaeb5b287f6b03 WatchSource:0}: Error finding container e688df4af3213731889e804e344bcf4d23290c3fa152d27b4eaaeb5b287f6b03: Status 404 returned error can't find the container with id e688df4af3213731889e804e344bcf4d23290c3fa152d27b4eaaeb5b287f6b03
Aug 05 17:17:34.316601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:34.316523    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fd280bc-43c4-4bf9-8c46-144186fa1691" path="/var/lib/kubelet/pods/2fd280bc-43c4-4bf9-8c46-144186fa1691/volumes"
Aug 05 17:17:34.391761 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:34.391730    2546 generic.go:356] "Generic (PLEG): container finished" podID="cbbc2e3c-1799-4675-95fa-b74a39103c40" containerID="81a7d9fd7aed4c3fd60bf5f51eacd1f92f64abbb3deb65a049f1c90a9c50795b" exitCode=0
Aug 05 17:17:34.391910 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:34.391791    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450538880" event={"ID":"cbbc2e3c-1799-4675-95fa-b74a39103c40","Type":"ContainerDied","Data":"81a7d9fd7aed4c3fd60bf5f51eacd1f92f64abbb3deb65a049f1c90a9c50795b"}
Aug 05 17:17:34.391910 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:34.391815    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7497-139681450538880" event={"ID":"cbbc2e3c-1799-4675-95fa-b74a39103c40","Type":"ContainerStarted","Data":"e688df4af3213731889e804e344bcf4d23290c3fa152d27b4eaaeb5b287f6b03"}
Aug 05 17:17:35.533727 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.533701    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:35.558614 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.558586    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7497-139681450538880_cbbc2e3c-1799-4675-95fa-b74a39103c40/test-curl-7497-139681450538880/0.log"
Aug 05 17:17:35.582524 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.582498    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7497-139681450538880"]
Aug 05 17:17:35.586456 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.586437    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7497-139681450538880"]
Aug 05 17:17:35.609337 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.609306    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw4pb\" (UniqueName: \"kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb\") pod \"cbbc2e3c-1799-4675-95fa-b74a39103c40\" (UID: \"cbbc2e3c-1799-4675-95fa-b74a39103c40\") "
Aug 05 17:17:35.611352 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.611314    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb" (OuterVolumeSpecName: "kube-api-access-dw4pb") pod "cbbc2e3c-1799-4675-95fa-b74a39103c40" (UID: "cbbc2e3c-1799-4675-95fa-b74a39103c40"). InnerVolumeSpecName "kube-api-access-dw4pb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:17:35.710482 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:35.710414    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw4pb\" (UniqueName: \"kubernetes.io/projected/cbbc2e3c-1799-4675-95fa-b74a39103c40-kube-api-access-dw4pb\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:17:36.310664 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:36.310631    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbc2e3c-1799-4675-95fa-b74a39103c40" path="/var/lib/kubelet/pods/cbbc2e3c-1799-4675-95fa-b74a39103c40/volumes"
Aug 05 17:17:36.405491 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:36.405454    2546 scope.go:117] "RemoveContainer" containerID="81a7d9fd7aed4c3fd60bf5f51eacd1f92f64abbb3deb65a049f1c90a9c50795b"
Aug 05 17:17:36.405674 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:36.405543    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7497-139681450538880"
Aug 05 17:17:41.054257 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.054218    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:17:41.054722 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.054705    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbc2e3c-1799-4675-95fa-b74a39103c40" containerName="test-curl-7497-139681450538880"
Aug 05 17:17:41.054783 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.054724    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbc2e3c-1799-4675-95fa-b74a39103c40" containerName="test-curl-7497-139681450538880"
Aug 05 17:17:41.054843 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.054833    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbc2e3c-1799-4675-95fa-b74a39103c40" containerName="test-curl-7497-139681450538880"
Aug 05 17:17:41.057580 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.057567    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.063831 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.063791    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-b2b0ab\""
Aug 05 17:17:41.063831 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.063795    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-b2b0ab-dockercfg-zcfc4\""
Aug 05 17:17:41.074364 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.074341    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:17:41.129854 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.129820    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:17:41.133016 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.132996    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.155782 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.155756    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:17:41.163575 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.163550    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.163679 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.163613    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8t7hb\" (UniqueName: \"kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.264988 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.264957    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.265138 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.265003    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8t7hb\" (UniqueName: \"kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.265138 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.265094    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.265218 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.265140    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lqg6\" (UniqueName: \"kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.265853 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.265834    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.277633 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.277606    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8t7hb\" (UniqueName: \"kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb\") pod \"payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.365761 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.365731    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lqg6\" (UniqueName: \"kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.365917 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.365815    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.366598 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.366578    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.367656 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.367638    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:41.378048 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.378022    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lqg6\" (UniqueName: \"kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6\") pod \"payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.442901 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.442870    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:41.529833 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.529804    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:17:41.531489 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:41.531456    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fa74005_875d_457e_8ff3_c00bcf510526.slice/crio-318519bcf07b94cb50a79ac1b115f07713512bb0b901919aad9c80eb06e5f028 WatchSource:0}: Error finding container 318519bcf07b94cb50a79ac1b115f07713512bb0b901919aad9c80eb06e5f028: Status 404 returned error can't find the container with id 318519bcf07b94cb50a79ac1b115f07713512bb0b901919aad9c80eb06e5f028
Aug 05 17:17:41.599294 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:41.599268    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:17:41.602140 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:17:41.602118    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44da45ed_1614_4c6d_b62c_18745bd3d51d.slice/crio-721c2c4282715eb506f75ddd196e5d8f409b5fe958251e662ce4eb7dc7b91c20 WatchSource:0}: Error finding container 721c2c4282715eb506f75ddd196e5d8f409b5fe958251e662ce4eb7dc7b91c20: Status 404 returned error can't find the container with id 721c2c4282715eb506f75ddd196e5d8f409b5fe958251e662ce4eb7dc7b91c20
Aug 05 17:17:42.445686 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.445633    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" event={"ID":"44da45ed-1614-4c6d-b62c-18745bd3d51d","Type":"ContainerStarted","Data":"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"}
Aug 05 17:17:42.446155 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.445708    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" event={"ID":"44da45ed-1614-4c6d-b62c-18745bd3d51d","Type":"ContainerStarted","Data":"721c2c4282715eb506f75ddd196e5d8f409b5fe958251e662ce4eb7dc7b91c20"}
Aug 05 17:17:42.446155 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.445844    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:42.447195 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.447168    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" event={"ID":"7fa74005-875d-457e-8ff3-c00bcf510526","Type":"ContainerStarted","Data":"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"}
Aug 05 17:17:42.447288 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.447221    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" event={"ID":"7fa74005-875d-457e-8ff3-c00bcf510526","Type":"ContainerStarted","Data":"318519bcf07b94cb50a79ac1b115f07713512bb0b901919aad9c80eb06e5f028"}
Aug 05 17:17:42.447288 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.447259    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:17:42.480707 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.480656    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" podStartSLOduration=1.480639762 podStartE2EDuration="1.480639762s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:17:42.475759972 +0000 UTC m=+3376.737070572" watchObservedRunningTime="2026-08-05 17:17:42.480639762 +0000 UTC m=+3376.741950360"
Aug 05 17:17:42.534184 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:42.534131    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" podStartSLOduration=1.534112542 podStartE2EDuration="1.534112542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:17:42.531137903 +0000 UTC m=+3376.792448513" watchObservedRunningTime="2026-08-05 17:17:42.534112542 +0000 UTC m=+3376.795423136"
Aug 05 17:17:43.706308 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:43.706272    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:17:53.454810 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:53.454779    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:17:53.455319 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:17:53.454859    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:18:09.235668 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.235632    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:18:09.241223 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.241198    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.243718 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.243685    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-f6c2cb-serving-cert\""
Aug 05 17:18:09.243863 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.243806    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:18:09.244629 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.244605    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Aug 05 17:18:09.244741 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.244611    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-pqmst\""
Aug 05 17:18:09.248099 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.248073    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:18:09.328187 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.328155    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.328403 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.328202    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltrn2\" (UniqueName: \"kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.328403 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.328233    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.429687 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.429648    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.429859 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.429717    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltrn2\" (UniqueName: \"kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.429859 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.429769    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.430472 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.430446    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.432096 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.432075    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.441684 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.441660    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltrn2\" (UniqueName: \"kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2\") pod \"maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.553769 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.553681    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:09.903155 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:09.903127    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:18:09.905278 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:18:09.905255    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod534d7bb9_4689_4217_8e67_bb12a18e5ec1.slice/crio-4735235d81187c78739275507393ced1f86153b6d0f41a1d7070a94694f195f3 WatchSource:0}: Error finding container 4735235d81187c78739275507393ced1f86153b6d0f41a1d7070a94694f195f3: Status 404 returned error can't find the container with id 4735235d81187c78739275507393ced1f86153b6d0f41a1d7070a94694f195f3
Aug 05 17:18:10.608169 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:10.608134    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" event={"ID":"534d7bb9-4689-4217-8e67-bb12a18e5ec1","Type":"ContainerStarted","Data":"4735235d81187c78739275507393ced1f86153b6d0f41a1d7070a94694f195f3"}
Aug 05 17:18:12.395387 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:12.395349    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:18:12.624122 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:12.624082    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" event={"ID":"534d7bb9-4689-4217-8e67-bb12a18e5ec1","Type":"ContainerStarted","Data":"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"}
Aug 05 17:18:12.624361 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:12.624152    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:12.647317 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:12.647225    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" podStartSLOduration=1.145411482 podStartE2EDuration="3.647209522s" totalImagesPullingTime="2.50179804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:18:12.64635935 +0000 UTC m=+3406.907669946" watchObservedRunningTime="2026-08-05 17:18:12.647209522 +0000 UTC m=+3406.908520139"
Aug 05 17:18:18.635845 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:18.635769    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:18:53.785554 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.785522    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:18:53.794467 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.794440    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.797166 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.797139    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-b2b0ab\"/\"ipp-route-b2b0ab-kserve-self-signed-certs\""
Aug 05 17:18:53.797166 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.797140    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-b2b0ab\"/\"default-dockercfg-vvfbc\""
Aug 05 17:18:53.797381 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.797143    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-b2b0ab\"/\"kube-root-ca.crt\""
Aug 05 17:18:53.797522 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.797499    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-b2b0ab\"/\"openshift-service-ca.crt\""
Aug 05 17:18:53.797830 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.797812    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:18:53.845900 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.845866    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.846046 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.845909    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.846046 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.845927    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.846046 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.846008    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.846194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.846052    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qjvh\" (UniqueName: \"kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.846194 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.846078    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.946985 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.946940    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.946996    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947012    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947049    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947086    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qjvh\" (UniqueName: \"kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947182 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947113    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947516 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947471    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947516 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947509    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.947633 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.947534    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.949432 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.949409    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.949581 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.949568    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:53.956961 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:53.956940    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qjvh\" (UniqueName: \"kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh\") pod \"ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") " pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:54.106517 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:54.106479    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:18:54.244354 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:54.244304    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:18:54.245888 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:18:54.245863    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbab2cb65_ef1e_4406_867f_3db50fd3c0aa.slice/crio-51d097d5f673d9f2e93a295c974d729cafdd27adfd75de472b1cdaa1ce8bd1cb WatchSource:0}: Error finding container 51d097d5f673d9f2e93a295c974d729cafdd27adfd75de472b1cdaa1ce8bd1cb: Status 404 returned error can't find the container with id 51d097d5f673d9f2e93a295c974d729cafdd27adfd75de472b1cdaa1ce8bd1cb
Aug 05 17:18:54.866749 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:54.866706    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" event={"ID":"bab2cb65-ef1e-4406-867f-3db50fd3c0aa","Type":"ContainerStarted","Data":"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"}
Aug 05 17:18:54.866749 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:54.866755    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" event={"ID":"bab2cb65-ef1e-4406-867f-3db50fd3c0aa","Type":"ContainerStarted","Data":"51d097d5f673d9f2e93a295c974d729cafdd27adfd75de472b1cdaa1ce8bd1cb"}
Aug 05 17:18:54.887305 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:54.887261    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" podStartSLOduration=1.887244498 podStartE2EDuration="1.887244498s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:18:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:18:54.884776381 +0000 UTC m=+3449.146086978" watchObservedRunningTime="2026-08-05 17:18:54.887244498 +0000 UTC m=+3449.148555097"
Aug 05 17:18:56.298246 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:18:56.298211    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:19:04.107241 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:04.107197    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:19:04.107772 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:04.107273    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:19:04.120038 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:04.120014    2546 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:19:04.934516 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:04.934488    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:19:18.822826 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:18.822789    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:19:29.679117 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:29.679065    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw_44da45ed-1614-4c6d-b62c-18745bd3d51d/payload-processing/0.log"
Aug 05 17:19:34.553488 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.553456    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:34.557386 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.557365    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.559464 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.559441    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-fc56ab-serving-cert\""
Aug 05 17:19:34.571507 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.571482    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:34.606032 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.606004    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqxxj\" (UniqueName: \"kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.606181 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.606047    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.606181 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.606066    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.707170 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.707141    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqxxj\" (UniqueName: \"kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.707390 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.707194    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.707390 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.707220    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.707390 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:19:34.707365    2546 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-serving-cert: secret "maas-api-e2e-ipp-cleanup-fc56ab-serving-cert" not found
Aug 05 17:19:34.707593 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:19:34.707427    2546 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls podName:411d4079-3fff-4e65-828b-3dd1c600d743 nodeName:}" failed. No retries permitted until 2026-08-05 17:19:35.207408674 +0000 UTC m=+3489.468719250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" (UID: "411d4079-3fff-4e65-828b-3dd1c600d743") : secret "maas-api-e2e-ipp-cleanup-fc56ab-serving-cert" not found
Aug 05 17:19:34.707944 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.707921    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:34.717444 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:34.717422    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqxxj\" (UniqueName: \"kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:35.212225 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:35.212190    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:35.214776 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:35.214752    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:35.469495 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:35.469409    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:35.610443 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:35.610421    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:35.612492 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:19:35.612463    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod411d4079_3fff_4e65_828b_3dd1c600d743.slice/crio-fb2661e0444a479de4da1de302045770ae632eb413b3ab45615f1089271d403b WatchSource:0}: Error finding container fb2661e0444a479de4da1de302045770ae632eb413b3ab45615f1089271d403b: Status 404 returned error can't find the container with id fb2661e0444a479de4da1de302045770ae632eb413b3ab45615f1089271d403b
Aug 05 17:19:36.108225 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:36.108194    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" event={"ID":"411d4079-3fff-4e65-828b-3dd1c600d743","Type":"ContainerStarted","Data":"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"}
Aug 05 17:19:36.108347 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:36.108245    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" event={"ID":"411d4079-3fff-4e65-828b-3dd1c600d743","Type":"ContainerStarted","Data":"fb2661e0444a479de4da1de302045770ae632eb413b3ab45615f1089271d403b"}
Aug 05 17:19:36.108347 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:36.108269    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:36.124737 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:36.124696    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" podStartSLOduration=1.70819079 podStartE2EDuration="2.124681787s" totalImagesPullingTime="416.490997ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:19:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:19:36.123405704 +0000 UTC m=+3490.384716303" watchObservedRunningTime="2026-08-05 17:19:36.124681787 +0000 UTC m=+3490.385992385"
Aug 05 17:19:40.397548 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:40.397515    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:19:42.119463 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:42.119434    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:48.849187 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:48.849110    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"]
Aug 05 17:19:48.852816 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:48.852799    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:48.855114 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:48.855094    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:19:48.861805 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:48.861779    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"]
Aug 05 17:19:48.941663 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:48.941629    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t\" (UID: \"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:49.042677 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:49.042642    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t\" (UID: \"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:49.043296 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:49.043277    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t\" (UID: \"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:49.165224 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:49.165128    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:49.309206 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:49.309170    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"]
Aug 05 17:19:49.311228 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:19:49.311205    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcfc129_01a6_46b8_97f3_93ffb7bfc85c.slice/crio-df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c WatchSource:0}: Error finding container df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c: Status 404 returned error can't find the container with id df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c
Aug 05 17:19:50.196921 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:50.196828    2546 generic.go:356] "Generic (PLEG): container finished" podID="ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" containerID="281f8f23770250bb1244d75b9b7493ceb3ff2b8dfd9939a8d17ce3cdaf14a77d" exitCode=0
Aug 05 17:19:50.197284 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:50.196916    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t" event={"ID":"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c","Type":"ContainerDied","Data":"281f8f23770250bb1244d75b9b7493ceb3ff2b8dfd9939a8d17ce3cdaf14a77d"}
Aug 05 17:19:50.197284 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:50.196969    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t" event={"ID":"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c","Type":"ContainerStarted","Data":"df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c"}
Aug 05 17:19:51.345954 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:51.345930    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:51.463373 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:51.463279    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca\") pod \"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c\" (UID: \"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c\") "
Aug 05 17:19:51.463699 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:51.463677    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" (UID: "ebcfc129-01a6-46b8-97f3-93ffb7bfc85c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:19:51.564353 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:51.564297    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:19:52.209616 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:52.209583    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t" event={"ID":"ebcfc129-01a6-46b8-97f3-93ffb7bfc85c","Type":"ContainerDied","Data":"df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c"}
Aug 05 17:19:52.209797 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:52.209656    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df7ce6680ca0b2972706f274f6d6f45d920f6f264540e4eebcea49ddbd6f3d5c"
Aug 05 17:19:52.209797 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:52.209593    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"
Aug 05 17:19:54.367560 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.367526    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:54.368042 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.367773    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" podUID="411d4079-3fff-4e65-828b-3dd1c600d743" containerName="maas-api" containerID="cri-o://8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341" gracePeriod=30
Aug 05 17:19:54.572389 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.572351    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"]
Aug 05 17:19:54.574898 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.574872    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-fc56ab-dzx8t"]
Aug 05 17:19:54.633165 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.633096    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:54.691433 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.691401    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") pod \"411d4079-3fff-4e65-828b-3dd1c600d743\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") "
Aug 05 17:19:54.691618 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.691447    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca\") pod \"411d4079-3fff-4e65-828b-3dd1c600d743\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") "
Aug 05 17:19:54.691618 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.691481    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqxxj\" (UniqueName: \"kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj\") pod \"411d4079-3fff-4e65-828b-3dd1c600d743\" (UID: \"411d4079-3fff-4e65-828b-3dd1c600d743\") "
Aug 05 17:19:54.691765 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.691743    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "411d4079-3fff-4e65-828b-3dd1c600d743" (UID: "411d4079-3fff-4e65-828b-3dd1c600d743"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:19:54.693772 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.693748    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "411d4079-3fff-4e65-828b-3dd1c600d743" (UID: "411d4079-3fff-4e65-828b-3dd1c600d743"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:19:54.693905 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.693779    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj" (OuterVolumeSpecName: "kube-api-access-zqxxj") pod "411d4079-3fff-4e65-828b-3dd1c600d743" (UID: "411d4079-3fff-4e65-828b-3dd1c600d743"). InnerVolumeSpecName "kube-api-access-zqxxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:19:54.792669 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.792636    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/411d4079-3fff-4e65-828b-3dd1c600d743-maas-api-tls\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:19:54.792669 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.792661    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/411d4079-3fff-4e65-828b-3dd1c600d743-openshift-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:19:54.792669 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:54.792670    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqxxj\" (UniqueName: \"kubernetes.io/projected/411d4079-3fff-4e65-828b-3dd1c600d743-kube-api-access-zqxxj\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:19:55.228560 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.228526    2546 generic.go:356] "Generic (PLEG): container finished" podID="411d4079-3fff-4e65-828b-3dd1c600d743" containerID="8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341" exitCode=0
Aug 05 17:19:55.228729 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.228573    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"
Aug 05 17:19:55.228729 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.228613    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" event={"ID":"411d4079-3fff-4e65-828b-3dd1c600d743","Type":"ContainerDied","Data":"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"}
Aug 05 17:19:55.228729 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.228671    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889" event={"ID":"411d4079-3fff-4e65-828b-3dd1c600d743","Type":"ContainerDied","Data":"fb2661e0444a479de4da1de302045770ae632eb413b3ab45615f1089271d403b"}
Aug 05 17:19:55.228729 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.228699    2546 scope.go:117] "RemoveContainer" containerID="8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"
Aug 05 17:19:55.238427 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.238409    2546 scope.go:117] "RemoveContainer" containerID="8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"
Aug 05 17:19:55.238669 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:19:55.238648    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341\": container with ID starting with 8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341 not found: ID does not exist" containerID="8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"
Aug 05 17:19:55.238712 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.238678    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341"} err="failed to get container status \"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341\": rpc error: code = NotFound desc = could not find container \"8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341\": container with ID starting with 8fc07c476a40b1529b4aee3f8af85d52e481d883c42d4a3e505ba5e0ce5a7341 not found: ID does not exist"
Aug 05 17:19:55.251487 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.251462    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:55.255710 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:55.255689    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-fc56ab-5cd456d6fb-lq889"]
Aug 05 17:19:56.311539 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:56.311506    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="411d4079-3fff-4e65-828b-3dd1c600d743" path="/var/lib/kubelet/pods/411d4079-3fff-4e65-828b-3dd1c600d743/volumes"
Aug 05 17:19:56.311926 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:56.311866    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" path="/var/lib/kubelet/pods/ebcfc129-01a6-46b8-97f3-93ffb7bfc85c/volumes"
Aug 05 17:19:58.498117 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:19:58.498077    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:20:04.373091 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373054    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"]
Aug 05 17:20:04.373499 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373468    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="411d4079-3fff-4e65-828b-3dd1c600d743" containerName="maas-api"
Aug 05 17:20:04.373499 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373480    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="411d4079-3fff-4e65-828b-3dd1c600d743" containerName="maas-api"
Aug 05 17:20:04.373580 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373515    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" containerName="revoke-keys"
Aug 05 17:20:04.373580 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373520    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" containerName="revoke-keys"
Aug 05 17:20:04.373655 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373618    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebcfc129-01a6-46b8-97f3-93ffb7bfc85c" containerName="revoke-keys"
Aug 05 17:20:04.373655 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.373631    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="411d4079-3fff-4e65-828b-3dd1c600d743" containerName="maas-api"
Aug 05 17:20:04.378175 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.378159    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:04.380544 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.380510    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:20:04.384302 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.384276    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"]
Aug 05 17:20:04.486605 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.486562    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h\" (UID: \"e13dd63b-8c19-4638-9e22-91fe81d293e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:04.588162 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.588108    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h\" (UID: \"e13dd63b-8c19-4638-9e22-91fe81d293e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:04.588816 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.588791    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h\" (UID: \"e13dd63b-8c19-4638-9e22-91fe81d293e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:04.689882 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.689800    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:04.833199 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:04.833164    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"]
Aug 05 17:20:04.833853 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:20:04.833829    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode13dd63b_8c19_4638_9e22_91fe81d293e1.slice/crio-00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1 WatchSource:0}: Error finding container 00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1: Status 404 returned error can't find the container with id 00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1
Aug 05 17:20:05.289883 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:05.289799    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h" event={"ID":"e13dd63b-8c19-4638-9e22-91fe81d293e1","Type":"ContainerStarted","Data":"341590e29dc2067b05a72774b53fa3a980dc66ac0e9532ef55235b5b86b2ea1a"}
Aug 05 17:20:05.289883 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:05.289862    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h" event={"ID":"e13dd63b-8c19-4638-9e22-91fe81d293e1","Type":"ContainerStarted","Data":"00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1"}
Aug 05 17:20:05.309421 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:05.309371    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h" podStartSLOduration=1.309357403 podStartE2EDuration="1.309357403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:20:05.307074691 +0000 UTC m=+3519.568385290" watchObservedRunningTime="2026-08-05 17:20:05.309357403 +0000 UTC m=+3519.570668001"
Aug 05 17:20:06.297740 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:06.297708    2546 generic.go:356] "Generic (PLEG): container finished" podID="e13dd63b-8c19-4638-9e22-91fe81d293e1" containerID="341590e29dc2067b05a72774b53fa3a980dc66ac0e9532ef55235b5b86b2ea1a" exitCode=0
Aug 05 17:20:06.298143 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:06.297757    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h" event={"ID":"e13dd63b-8c19-4638-9e22-91fe81d293e1","Type":"ContainerDied","Data":"341590e29dc2067b05a72774b53fa3a980dc66ac0e9532ef55235b5b86b2ea1a"}
Aug 05 17:20:07.451924 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:07.451898    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:07.616144 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:07.615970    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca\") pod \"e13dd63b-8c19-4638-9e22-91fe81d293e1\" (UID: \"e13dd63b-8c19-4638-9e22-91fe81d293e1\") "
Aug 05 17:20:07.616702 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:07.616677    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e13dd63b-8c19-4638-9e22-91fe81d293e1" (UID: "e13dd63b-8c19-4638-9e22-91fe81d293e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:20:07.717679 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:07.717647    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e13dd63b-8c19-4638-9e22-91fe81d293e1-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:08.310188 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:08.310157    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"
Aug 05 17:20:08.310407 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:08.310337    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h" event={"ID":"e13dd63b-8c19-4638-9e22-91fe81d293e1","Type":"ContainerDied","Data":"00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1"}
Aug 05 17:20:08.310407 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:08.310377    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00c26ffcb1501bdc594884313b7322aac7e9f46bfb1a8060c6d7521039807ba1"
Aug 05 17:20:13.108217 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:13.108178    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:20:14.985536 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:14.985503    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:20:14.986012 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:14.985762    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" podUID="44da45ed-1614-4c6d-b62c-18745bd3d51d" containerName="payload-processing" containerID="cri-o://647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5" gracePeriod=30
Aug 05 17:20:15.015256 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.015228    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:20:15.015508 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.015478    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" podUID="7fa74005-875d-457e-8ff3-c00bcf510526" containerName="payload-pre-processing" containerID="cri-o://1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699" gracePeriod=30
Aug 05 17:20:15.287077 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.287047    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"]
Aug 05 17:20:15.295586 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.295565    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-b2b0ab-xb94h"]
Aug 05 17:20:15.302717 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.302668    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:20:15.305830 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.305807    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:20:15.354585 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.354549    2546 generic.go:356] "Generic (PLEG): container finished" podID="44da45ed-1614-4c6d-b62c-18745bd3d51d" containerID="647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5" exitCode=0
Aug 05 17:20:15.354585 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.354582    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"
Aug 05 17:20:15.354853 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.354629    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" event={"ID":"44da45ed-1614-4c6d-b62c-18745bd3d51d","Type":"ContainerDied","Data":"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"}
Aug 05 17:20:15.354853 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.354690    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw" event={"ID":"44da45ed-1614-4c6d-b62c-18745bd3d51d","Type":"ContainerDied","Data":"721c2c4282715eb506f75ddd196e5d8f409b5fe958251e662ce4eb7dc7b91c20"}
Aug 05 17:20:15.354853 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.354724    2546 scope.go:117] "RemoveContainer" containerID="647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"
Aug 05 17:20:15.356447 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.356422    2546 generic.go:356] "Generic (PLEG): container finished" podID="7fa74005-875d-457e-8ff3-c00bcf510526" containerID="1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699" exitCode=0
Aug 05 17:20:15.356557 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.356476    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"
Aug 05 17:20:15.356557 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.356517    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" event={"ID":"7fa74005-875d-457e-8ff3-c00bcf510526","Type":"ContainerDied","Data":"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"}
Aug 05 17:20:15.356655 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.356569    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r" event={"ID":"7fa74005-875d-457e-8ff3-c00bcf510526","Type":"ContainerDied","Data":"318519bcf07b94cb50a79ac1b115f07713512bb0b901919aad9c80eb06e5f028"}
Aug 05 17:20:15.364450 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.364432    2546 scope.go:117] "RemoveContainer" containerID="647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"
Aug 05 17:20:15.364714 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:20:15.364695    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5\": container with ID starting with 647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5 not found: ID does not exist" containerID="647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"
Aug 05 17:20:15.364789 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.364721    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5"} err="failed to get container status \"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5\": rpc error: code = NotFound desc = could not find container \"647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5\": container with ID starting with 647c8655e48f2aff5b6a39fa6f1d1bc17be114746c372aa34757e20d72dffdf5 not found: ID does not exist"
Aug 05 17:20:15.364789 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.364738    2546 scope.go:117] "RemoveContainer" containerID="1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"
Aug 05 17:20:15.373607 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.373588    2546 scope.go:117] "RemoveContainer" containerID="1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"
Aug 05 17:20:15.373847 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:20:15.373829    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699\": container with ID starting with 1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699 not found: ID does not exist" containerID="1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"
Aug 05 17:20:15.373915 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.373855    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699"} err="failed to get container status \"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699\": rpc error: code = NotFound desc = could not find container \"1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699\": container with ID starting with 1fd1704822304f4c6f9dd1f7100b10076c2c109fee8e53075885d3a9136c8699 not found: ID does not exist"
Aug 05 17:20:15.385518 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.385498    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8t7hb\" (UniqueName: \"kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb\") pod \"7fa74005-875d-457e-8ff3-c00bcf510526\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") "
Aug 05 17:20:15.385593 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.385528    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lqg6\" (UniqueName: \"kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6\") pod \"44da45ed-1614-4c6d-b62c-18745bd3d51d\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") "
Aug 05 17:20:15.385691 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.385674    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume\") pod \"44da45ed-1614-4c6d-b62c-18745bd3d51d\" (UID: \"44da45ed-1614-4c6d-b62c-18745bd3d51d\") "
Aug 05 17:20:15.385752 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.385727    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume\") pod \"7fa74005-875d-457e-8ff3-c00bcf510526\" (UID: \"7fa74005-875d-457e-8ff3-c00bcf510526\") "
Aug 05 17:20:15.386053 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.386031    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "44da45ed-1614-4c6d-b62c-18745bd3d51d" (UID: "44da45ed-1614-4c6d-b62c-18745bd3d51d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:20:15.386134 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.386107    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7fa74005-875d-457e-8ff3-c00bcf510526" (UID: "7fa74005-875d-457e-8ff3-c00bcf510526"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:20:15.387705 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.387661    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb" (OuterVolumeSpecName: "kube-api-access-8t7hb") pod "7fa74005-875d-457e-8ff3-c00bcf510526" (UID: "7fa74005-875d-457e-8ff3-c00bcf510526"). InnerVolumeSpecName "kube-api-access-8t7hb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:20:15.387839 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.387816    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6" (OuterVolumeSpecName: "kube-api-access-2lqg6") pod "44da45ed-1614-4c6d-b62c-18745bd3d51d" (UID: "44da45ed-1614-4c6d-b62c-18745bd3d51d"). InnerVolumeSpecName "kube-api-access-2lqg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:20:15.486483 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.486439    2546 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/44da45ed-1614-4c6d-b62c-18745bd3d51d-plugins-config-volume\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.486483 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.486476    2546 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7fa74005-875d-457e-8ff3-c00bcf510526-plugins-config-volume\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.486483 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.486489    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8t7hb\" (UniqueName: \"kubernetes.io/projected/7fa74005-875d-457e-8ff3-c00bcf510526-kube-api-access-8t7hb\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.486731 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.486501    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lqg6\" (UniqueName: \"kubernetes.io/projected/44da45ed-1614-4c6d-b62c-18745bd3d51d-kube-api-access-2lqg6\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:15.680192 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.680157    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:20:15.682673 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.682648    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-b2b0ab-55d8b4b584-f5qdw"]
Aug 05 17:20:15.692519 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.692494    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:20:15.702659 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:15.702635    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-b2b0ab-77bf64b4-9c29r"]
Aug 05 17:20:16.311029 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:16.310996    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44da45ed-1614-4c6d-b62c-18745bd3d51d" path="/var/lib/kubelet/pods/44da45ed-1614-4c6d-b62c-18745bd3d51d/volumes"
Aug 05 17:20:16.311436 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:16.311368    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7fa74005-875d-457e-8ff3-c00bcf510526" path="/var/lib/kubelet/pods/7fa74005-875d-457e-8ff3-c00bcf510526/volumes"
Aug 05 17:20:16.311660 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:16.311647    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e13dd63b-8c19-4638-9e22-91fe81d293e1" path="/var/lib/kubelet/pods/e13dd63b-8c19-4638-9e22-91fe81d293e1/volumes"
Aug 05 17:20:20.619251 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:20.619214    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:20:21.711596 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:21.711562    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:20:35.638881 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.638834    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" podUID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" containerName="main" containerID="cri-o://6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16" gracePeriod=45
Aug 05 17:20:35.891232 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.891177    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:20:35.974663 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974635    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.974849 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974672    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6qjvh\" (UniqueName: \"kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.974849 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974699    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.974978 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974872    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.974978 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974895    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache" (OuterVolumeSpecName: "model-cache") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:35.974978 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974947    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.974978 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974950    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:35.975147 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.974994    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home\") pod \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\" (UID: \"bab2cb65-ef1e-4406-867f-3db50fd3c0aa\") "
Aug 05 17:20:35.975259 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.975234    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home" (OuterVolumeSpecName: "home") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:35.975393 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.975354    2546 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-home\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:35.975393 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.975374    2546 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-model-cache\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:35.975393 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.975390    2546 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tmp-dir\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:35.977005 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.976978    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:20:35.977005 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.976990    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh" (OuterVolumeSpecName: "kube-api-access-6qjvh") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "kube-api-access-6qjvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:20:35.977139 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:35.977036    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm" (OuterVolumeSpecName: "dshm") pod "bab2cb65-ef1e-4406-867f-3db50fd3c0aa" (UID: "bab2cb65-ef1e-4406-867f-3db50fd3c0aa"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Aug 05 17:20:36.076392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.076358    2546 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-dshm\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:36.076392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.076389    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6qjvh\" (UniqueName: \"kubernetes.io/projected/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-kube-api-access-6qjvh\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:36.076392 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.076400    2546 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bab2cb65-ef1e-4406-867f-3db50fd3c0aa-tls-certs\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:20:36.488409 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.488373    2546 generic.go:356] "Generic (PLEG): container finished" podID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" containerID="6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16" exitCode=0
Aug 05 17:20:36.488579 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.488415    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"
Aug 05 17:20:36.488579 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.488457    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" event={"ID":"bab2cb65-ef1e-4406-867f-3db50fd3c0aa","Type":"ContainerDied","Data":"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"}
Aug 05 17:20:36.488579 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.488497    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7" event={"ID":"bab2cb65-ef1e-4406-867f-3db50fd3c0aa","Type":"ContainerDied","Data":"51d097d5f673d9f2e93a295c974d729cafdd27adfd75de472b1cdaa1ce8bd1cb"}
Aug 05 17:20:36.488579 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.488516    2546 scope.go:117] "RemoveContainer" containerID="6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"
Aug 05 17:20:36.497358 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.497339    2546 scope.go:117] "RemoveContainer" containerID="6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"
Aug 05 17:20:36.497616 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:20:36.497598    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16\": container with ID starting with 6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16 not found: ID does not exist" containerID="6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"
Aug 05 17:20:36.497690 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.497622    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16"} err="failed to get container status \"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16\": rpc error: code = NotFound desc = could not find container \"6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16\": container with ID starting with 6cab089b0a4b5d23312db3c121b12f0622740c00ef91d7032b7554af96636f16 not found: ID does not exist"
Aug 05 17:20:36.505644 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.505621    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:20:36.511770 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:36.511749    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-b2b0ab/ipp-route-b2b0ab-kserve-58848fd6ff-f6nq7"]
Aug 05 17:20:38.315121 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:20:38.315087    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" path="/var/lib/kubelet/pods/bab2cb65-ef1e-4406-867f-3db50fd3c0aa/volumes"
Aug 05 17:21:04.765149 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765118    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"]
Aug 05 17:21:04.765535 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765521    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44da45ed-1614-4c6d-b62c-18745bd3d51d" containerName="payload-processing"
Aug 05 17:21:04.765535 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765532    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="44da45ed-1614-4c6d-b62c-18745bd3d51d" containerName="payload-processing"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765544    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" containerName="main"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765549    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" containerName="main"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765559    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e13dd63b-8c19-4638-9e22-91fe81d293e1" containerName="revoke-keys"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765565    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="e13dd63b-8c19-4638-9e22-91fe81d293e1" containerName="revoke-keys"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765584    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7fa74005-875d-457e-8ff3-c00bcf510526" containerName="payload-pre-processing"
Aug 05 17:21:04.765615 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765589    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="7fa74005-875d-457e-8ff3-c00bcf510526" containerName="payload-pre-processing"
Aug 05 17:21:04.765799 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765647    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="7fa74005-875d-457e-8ff3-c00bcf510526" containerName="payload-pre-processing"
Aug 05 17:21:04.765799 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765655    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="44da45ed-1614-4c6d-b62c-18745bd3d51d" containerName="payload-processing"
Aug 05 17:21:04.765799 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765662    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="bab2cb65-ef1e-4406-867f-3db50fd3c0aa" containerName="main"
Aug 05 17:21:04.765799 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.765668    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="e13dd63b-8c19-4638-9e22-91fe81d293e1" containerName="revoke-keys"
Aug 05 17:21:04.771082 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.771050    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:04.773991 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.773968    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:21:04.777409 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.777384    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"]
Aug 05 17:21:04.830065 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.830024    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m\" (UID: \"607f94ff-7c01-4a9d-b3e7-5222f7e382a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:04.931374 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.931282    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m\" (UID: \"607f94ff-7c01-4a9d-b3e7-5222f7e382a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:04.931921 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:04.931899    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m\" (UID: \"607f94ff-7c01-4a9d-b3e7-5222f7e382a7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:05.083838 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:05.083751    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:05.223926 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:05.223838    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"]
Aug 05 17:21:05.226190 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:21:05.226164    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607f94ff_7c01_4a9d_b3e7_5222f7e382a7.slice/crio-d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9 WatchSource:0}: Error finding container d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9: Status 404 returned error can't find the container with id d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9
Aug 05 17:21:05.658898 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:05.658861    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m" event={"ID":"607f94ff-7c01-4a9d-b3e7-5222f7e382a7","Type":"ContainerStarted","Data":"34a4275afc1fa5a46dfc1f9d1ebd26befdbaa4cb5c68fb9d1837d9ea958639c4"}
Aug 05 17:21:05.659113 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:05.658912    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m" event={"ID":"607f94ff-7c01-4a9d-b3e7-5222f7e382a7","Type":"ContainerStarted","Data":"d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9"}
Aug 05 17:21:05.681593 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:05.681540    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m" podStartSLOduration=1.681524427 podStartE2EDuration="1.681524427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-08-05 17:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:21:05.679701068 +0000 UTC m=+3579.941011667" watchObservedRunningTime="2026-08-05 17:21:05.681524427 +0000 UTC m=+3579.942835056"
Aug 05 17:21:06.666138 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:06.666105    2546 generic.go:356] "Generic (PLEG): container finished" podID="607f94ff-7c01-4a9d-b3e7-5222f7e382a7" containerID="34a4275afc1fa5a46dfc1f9d1ebd26befdbaa4cb5c68fb9d1837d9ea958639c4" exitCode=0
Aug 05 17:21:06.666592 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:06.666198    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m" event={"ID":"607f94ff-7c01-4a9d-b3e7-5222f7e382a7","Type":"ContainerDied","Data":"34a4275afc1fa5a46dfc1f9d1ebd26befdbaa4cb5c68fb9d1837d9ea958639c4"}
Aug 05 17:21:07.808087 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:07.808059    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:07.852050 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:07.852020    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca\") pod \"607f94ff-7c01-4a9d-b3e7-5222f7e382a7\" (UID: \"607f94ff-7c01-4a9d-b3e7-5222f7e382a7\") "
Aug 05 17:21:07.852350 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:07.852315    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "607f94ff-7c01-4a9d-b3e7-5222f7e382a7" (UID: "607f94ff-7c01-4a9d-b3e7-5222f7e382a7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:07.952940 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:07.952860    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607f94ff-7c01-4a9d-b3e7-5222f7e382a7-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:08.679173 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:08.679145    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"
Aug 05 17:21:08.679173 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:08.679163    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m" event={"ID":"607f94ff-7c01-4a9d-b3e7-5222f7e382a7","Type":"ContainerDied","Data":"d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9"}
Aug 05 17:21:08.679398 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:08.679213    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d90c8a4022ff59b591b8ae71e4b19e4a8dea3b13edfe4cc05e66b8fc2eb2a6e9"
Aug 05 17:21:15.326409 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.326378    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:21:15.326932 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.326550    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" podUID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" containerName="maas-api" containerID="cri-o://aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c" gracePeriod=30
Aug 05 17:21:15.578539 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.578477    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:21:15.620820 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.620785    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca\") pod \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") "
Aug 05 17:21:15.620820 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.620827    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ltrn2\" (UniqueName: \"kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2\") pod \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") "
Aug 05 17:21:15.621074 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.620936    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls\") pod \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\" (UID: \"534d7bb9-4689-4217-8e67-bb12a18e5ec1\") "
Aug 05 17:21:15.621135 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.621103    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "534d7bb9-4689-4217-8e67-bb12a18e5ec1" (UID: "534d7bb9-4689-4217-8e67-bb12a18e5ec1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:15.623052 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.623026    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2" (OuterVolumeSpecName: "kube-api-access-ltrn2") pod "534d7bb9-4689-4217-8e67-bb12a18e5ec1" (UID: "534d7bb9-4689-4217-8e67-bb12a18e5ec1"). InnerVolumeSpecName "kube-api-access-ltrn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:15.623052 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.623040    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "534d7bb9-4689-4217-8e67-bb12a18e5ec1" (UID: "534d7bb9-4689-4217-8e67-bb12a18e5ec1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Aug 05 17:21:15.721314 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721278    2546 generic.go:356] "Generic (PLEG): container finished" podID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" containerID="aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c" exitCode=0
Aug 05 17:21:15.721533 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721341    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"
Aug 05 17:21:15.721533 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721359    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" event={"ID":"534d7bb9-4689-4217-8e67-bb12a18e5ec1","Type":"ContainerDied","Data":"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"}
Aug 05 17:21:15.721533 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721427    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8" event={"ID":"534d7bb9-4689-4217-8e67-bb12a18e5ec1","Type":"ContainerDied","Data":"4735235d81187c78739275507393ced1f86153b6d0f41a1d7070a94694f195f3"}
Aug 05 17:21:15.721533 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721458    2546 scope.go:117] "RemoveContainer" containerID="aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"
Aug 05 17:21:15.721747 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721563    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/534d7bb9-4689-4217-8e67-bb12a18e5ec1-maas-api-tls\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.721747 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721587    2546 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/534d7bb9-4689-4217-8e67-bb12a18e5ec1-openshift-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.721747 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.721604    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ltrn2\" (UniqueName: \"kubernetes.io/projected/534d7bb9-4689-4217-8e67-bb12a18e5ec1-kube-api-access-ltrn2\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:15.732408 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.732391    2546 scope.go:117] "RemoveContainer" containerID="aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"
Aug 05 17:21:15.732692 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:21:15.732674    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c\": container with ID starting with aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c not found: ID does not exist" containerID="aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"
Aug 05 17:21:15.732750 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.732702    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c"} err="failed to get container status \"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c\": rpc error: code = NotFound desc = could not find container \"aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c\": container with ID starting with aad51572122fc7b2c7a3aa9b59b943b6faf81354cb8bd45d54c9c3f1a8904a7c not found: ID does not exist"
Aug 05 17:21:15.759874 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.759842    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:21:15.768190 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.768164    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-f6c2cb-5dcbd8dd97-69zl8"]
Aug 05 17:21:15.879761 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.879732    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"]
Aug 05 17:21:15.889834 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:15.889805    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-f6c2cb-w8j5m"]
Aug 05 17:21:16.321368 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:16.321273    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" path="/var/lib/kubelet/pods/534d7bb9-4689-4217-8e67-bb12a18e5ec1/volumes"
Aug 05 17:21:16.321665 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:16.321650    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607f94ff-7c01-4a9d-b3e7-5222f7e382a7" path="/var/lib/kubelet/pods/607f94ff-7c01-4a9d-b3e7-5222f7e382a7/volumes"
Aug 05 17:21:17.799368 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:17.799331    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:21:22.573497 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573418    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"]
Aug 05 17:21:22.573858 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573807    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" containerName="maas-api"
Aug 05 17:21:22.573858 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573817    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" containerName="maas-api"
Aug 05 17:21:22.573858 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573841    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607f94ff-7c01-4a9d-b3e7-5222f7e382a7" containerName="revoke-keys"
Aug 05 17:21:22.573858 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573846    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="607f94ff-7c01-4a9d-b3e7-5222f7e382a7" containerName="revoke-keys"
Aug 05 17:21:22.573991 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573903    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="534d7bb9-4689-4217-8e67-bb12a18e5ec1" containerName="maas-api"
Aug 05 17:21:22.573991 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.573914    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="607f94ff-7c01-4a9d-b3e7-5222f7e382a7" containerName="revoke-keys"
Aug 05 17:21:22.578185 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.578170    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:22.580612 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.580590    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:21:22.580726 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.580636    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:21:22.585253 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.585229    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"]
Aug 05 17:21:22.682560 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.682523    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq\" (UID: \"4b04dad8-3fa0-4c9d-af77-808af983ff3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:22.783443 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.783411    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq\" (UID: \"4b04dad8-3fa0-4c9d-af77-808af983ff3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:22.784097 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.784078    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq\" (UID: \"4b04dad8-3fa0-4c9d-af77-808af983ff3e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:22.889830 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:22.889802    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:23.027700 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:23.027675    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"]
Aug 05 17:21:23.028847 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:21:23.028821    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b04dad8_3fa0_4c9d_af77_808af983ff3e.slice/crio-d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55 WatchSource:0}: Error finding container d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55: Status 404 returned error can't find the container with id d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55
Aug 05 17:21:23.771566 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:23.771527    2546 generic.go:356] "Generic (PLEG): container finished" podID="4b04dad8-3fa0-4c9d-af77-808af983ff3e" containerID="1438a77ab295fc282df8ac759e08ce1e0a869ce2694a7629428c70fd4ccb3831" exitCode=0
Aug 05 17:21:23.771952 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:23.771608    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq" event={"ID":"4b04dad8-3fa0-4c9d-af77-808af983ff3e","Type":"ContainerDied","Data":"1438a77ab295fc282df8ac759e08ce1e0a869ce2694a7629428c70fd4ccb3831"}
Aug 05 17:21:23.771952 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:23.771654    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq" event={"ID":"4b04dad8-3fa0-4c9d-af77-808af983ff3e","Type":"ContainerStarted","Data":"d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55"}
Aug 05 17:21:24.914626 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:24.914605    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:25.001755 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.001727    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca\") pod \"4b04dad8-3fa0-4c9d-af77-808af983ff3e\" (UID: \"4b04dad8-3fa0-4c9d-af77-808af983ff3e\") "
Aug 05 17:21:25.002086 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.002064    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4b04dad8-3fa0-4c9d-af77-808af983ff3e" (UID: "4b04dad8-3fa0-4c9d-af77-808af983ff3e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:25.102980 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.102942    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4b04dad8-3fa0-4c9d-af77-808af983ff3e-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:25.785469 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.785439    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"
Aug 05 17:21:25.785639 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.785435    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq" event={"ID":"4b04dad8-3fa0-4c9d-af77-808af983ff3e","Type":"ContainerDied","Data":"d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55"}
Aug 05 17:21:25.785639 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:25.785561    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d06202e4fb925b04473df0b65bccd79c7c645c6ed3a1453c74e37ec9ece00c55"
Aug 05 17:21:26.567896 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:26.567869    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:21:26.580129 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:26.580109    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:21:33.156493 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:33.156460    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"]
Aug 05 17:21:33.158904 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:33.158879    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-02b433-29765835-xxbbk"]
Aug 05 17:21:33.366776 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:33.366710    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"]
Aug 05 17:21:33.369786 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:33.369760    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-02b433-vj4vq"]
Aug 05 17:21:34.310167 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:34.310130    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39d93189-ebe9-4009-9f2b-0cb8c3e91db0" path="/var/lib/kubelet/pods/39d93189-ebe9-4009-9f2b-0cb8c3e91db0/volumes"
Aug 05 17:21:34.310672 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:34.310576    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b04dad8-3fa0-4c9d-af77-808af983ff3e" path="/var/lib/kubelet/pods/4b04dad8-3fa0-4c9d-af77-808af983ff3e/volumes"
Aug 05 17:21:35.302862 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:35.302831    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:21:40.500828 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.500794    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"]
Aug 05 17:21:40.501229 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.501175    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b04dad8-3fa0-4c9d-af77-808af983ff3e" containerName="revoke-keys"
Aug 05 17:21:40.501229 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.501186    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b04dad8-3fa0-4c9d-af77-808af983ff3e" containerName="revoke-keys"
Aug 05 17:21:40.501302 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.501275    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b04dad8-3fa0-4c9d-af77-808af983ff3e" containerName="revoke-keys"
Aug 05 17:21:40.505799 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.505783    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:40.508212 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.508188    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Aug 05 17:21:40.508384 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.508192    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q6h9g\""
Aug 05 17:21:40.512492 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.512465    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"]
Aug 05 17:21:40.647076 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.647046    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2\" (UID: \"874d9095-eff9-49e8-b180-fea802ff2a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:40.747876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.747846    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2\" (UID: \"874d9095-eff9-49e8-b180-fea802ff2a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:40.748491 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.748472    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2\" (UID: \"874d9095-eff9-49e8-b180-fea802ff2a60\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:40.817594 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.817516    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:40.967899 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:40.967866    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"]
Aug 05 17:21:40.969056 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:21:40.969031    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod874d9095_eff9_49e8_b180_fea802ff2a60.slice/crio-8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def WatchSource:0}: Error finding container 8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def: Status 404 returned error can't find the container with id 8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def
Aug 05 17:21:41.885249 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:41.885159    2546 generic.go:356] "Generic (PLEG): container finished" podID="874d9095-eff9-49e8-b180-fea802ff2a60" containerID="b34e42758d6f03abdbcff75cc6e76face9c842e66075ac3fe8dcea0403753d6f" exitCode=0
Aug 05 17:21:41.885645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:41.885251    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2" event={"ID":"874d9095-eff9-49e8-b180-fea802ff2a60","Type":"ContainerDied","Data":"b34e42758d6f03abdbcff75cc6e76face9c842e66075ac3fe8dcea0403753d6f"}
Aug 05 17:21:41.885645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:41.885314    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2" event={"ID":"874d9095-eff9-49e8-b180-fea802ff2a60","Type":"ContainerStarted","Data":"8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def"}
Aug 05 17:21:43.032917 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.032890    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:43.169810 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.169729    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca\") pod \"874d9095-eff9-49e8-b180-fea802ff2a60\" (UID: \"874d9095-eff9-49e8-b180-fea802ff2a60\") "
Aug 05 17:21:43.170068 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.170046    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "874d9095-eff9-49e8-b180-fea802ff2a60" (UID: "874d9095-eff9-49e8-b180-fea802ff2a60"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:43.270644 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.270606    2546 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/874d9095-eff9-49e8-b180-fea802ff2a60-maas-api-service-ca\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:43.897643 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.897617    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"
Aug 05 17:21:43.897840 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.897654    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2" event={"ID":"874d9095-eff9-49e8-b180-fea802ff2a60","Type":"ContainerDied","Data":"8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def"}
Aug 05 17:21:43.897840 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:43.897700    2546 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8f4339893a40049b0613a59e287ecdd2c3808c69a2c39ea3b6e9882bfccb5def"
Aug 05 17:21:50.977997 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:50.977960    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"]
Aug 05 17:21:50.980467 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:50.980438    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-46e6bf-29765835-xcdct"]
Aug 05 17:21:51.012238 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.012207    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:21:51.012544 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.012434    2546 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" podUID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" containerName="payload-pre-processing" containerID="cri-o://75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb" gracePeriod=30
Aug 05 17:21:51.187160 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.187081    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"]
Aug 05 17:21:51.189939 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.189917    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-46e6bf-2cfg2"]
Aug 05 17:21:51.277160 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.277133    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:21:51.443936 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.443905    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-76pd8\" (UniqueName: \"kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8\") pod \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") "
Aug 05 17:21:51.443936 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.443941    2546 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume\") pod \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\" (UID: \"8de0fe84-1050-4af7-9abe-53c5e633ea0b\") "
Aug 05 17:21:51.444399 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.444363    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8de0fe84-1050-4af7-9abe-53c5e633ea0b" (UID: "8de0fe84-1050-4af7-9abe-53c5e633ea0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Aug 05 17:21:51.446071 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.446051    2546 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8" (OuterVolumeSpecName: "kube-api-access-76pd8") pod "8de0fe84-1050-4af7-9abe-53c5e633ea0b" (UID: "8de0fe84-1050-4af7-9abe-53c5e633ea0b"). InnerVolumeSpecName "kube-api-access-76pd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Aug 05 17:21:51.545687 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.545608    2546 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-76pd8\" (UniqueName: \"kubernetes.io/projected/8de0fe84-1050-4af7-9abe-53c5e633ea0b-kube-api-access-76pd8\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.545687 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.545636    2546 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8de0fe84-1050-4af7-9abe-53c5e633ea0b-plugins-config-volume\") on node \"ip-10-0-134-153.ec2.internal\" DevicePath \"\""
Aug 05 17:21:51.955385 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.955351    2546 generic.go:356] "Generic (PLEG): container finished" podID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" containerID="75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb" exitCode=0
Aug 05 17:21:51.955563 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.955392    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" event={"ID":"8de0fe84-1050-4af7-9abe-53c5e633ea0b","Type":"ContainerDied","Data":"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"}
Aug 05 17:21:51.955563 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.955403    2546 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"
Aug 05 17:21:51.955563 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.955454    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg" event={"ID":"8de0fe84-1050-4af7-9abe-53c5e633ea0b","Type":"ContainerDied","Data":"fc28c53edd89cc0a835ffa22e99c8e1a9143d8415888b66cabcebdb15b79d885"}
Aug 05 17:21:51.955563 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.955476    2546 scope.go:117] "RemoveContainer" containerID="75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"
Aug 05 17:21:51.965623 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.965603    2546 scope.go:117] "RemoveContainer" containerID="75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"
Aug 05 17:21:51.965894 ip-10-0-134-153 kubenswrapper[2546]: E0805 17:21:51.965874    2546 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb\": container with ID starting with 75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb not found: ID does not exist" containerID="75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"
Aug 05 17:21:51.965947 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.965903    2546 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb"} err="failed to get container status \"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb\": rpc error: code = NotFound desc = could not find container \"75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb\": container with ID starting with 75726a175c52eaf36f32e8c2306ce3ed00e3e8525efde0fb4a2706dedb317ebb not found: ID does not exist"
Aug 05 17:21:51.977509 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.977483    2546 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:21:51.983028 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:51.983007    2546 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-46e6bf-7654444fdd-gq9tg"]
Aug 05 17:21:52.309693 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:52.309616    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cc127b2-0a87-4ce9-a267-81abfecef3ff" path="/var/lib/kubelet/pods/6cc127b2-0a87-4ce9-a267-81abfecef3ff/volumes"
Aug 05 17:21:52.309916 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:52.309904    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="874d9095-eff9-49e8-b180-fea802ff2a60" path="/var/lib/kubelet/pods/874d9095-eff9-49e8-b180-fea802ff2a60/volumes"
Aug 05 17:21:52.310212 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:52.310201    2546 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" path="/var/lib/kubelet/pods/8de0fe84-1050-4af7-9abe-53c5e633ea0b/volumes"
Aug 05 17:21:53.001438 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:21:53.001405    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-x7cbq"]
Aug 05 17:22:03.615576 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:03.615548    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w6jqw_b8d61e39-229b-40b9-9e7e-bbb43570b45f/manager/0.log"
Aug 05 17:22:03.732043 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:03.732003    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-79cf6_96c67940-d5aa-4690-8391-9a5c08d301fd/manager/0.log"
Aug 05 17:22:03.975900 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:03.975819    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fkjrn_b6b67f64-253f-4404-862f-3afded59a9ea/server/0.log"
Aug 05 17:22:04.093318 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:04.093289    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l64rq_7513a5ab-c148-48e2-8026-d44974934808/manager/0.log"
Aug 05 17:22:04.442599 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:04.442571    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-zfxtw_7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d/manager/0.log"
Aug 05 17:22:04.449580 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:04.449559    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-zfxtw_7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d/copy-manifests/0.log"
Aug 05 17:22:05.094457 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:05.094427    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29765835-2shkr_c994c252-4865-4c38-8fae-d78a488780f3/cleanup/0.log"
Aug 05 17:22:06.033834 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:06.033790    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-p9jz7_32035862-e374-419f-ba1f-06fa7dfe3d94/manager/0.log"
Aug 05 17:22:06.143445 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:06.143401    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-ql82n_9313738c-2854-4bfc-a425-bbdaf8557822/manager/0.log"
Aug 05 17:22:06.474517 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:06.474491    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-x7cbq_94800ea5-0190-4c01-b71c-523c3bb0674d/limitador/0.log"
Aug 05 17:22:07.050629 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:07.050604    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s55pd_3528698f-27a0-48d1-8663-7466bfdc61b0/discovery/0.log"
Aug 05 17:22:07.152788 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:07.152761    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-6v9n6_06549988-9852-4703-afee-39e26cd336a9/kube-auth-proxy/0.log"
Aug 05 17:22:08.146926 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:08.146896    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-m8s8b_70205647-bee7-48bf-96b5-ccb59563f331/main/0.log"
Aug 05 17:22:08.365953 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:08.365923    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frkl8s_ed3877d4-362a-4139-b4b5-59fc84c98aa7/main/0.log"
Aug 05 17:22:16.926008 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:16.925978    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6kjcp_08792d7f-edb3-4507-96d9-f6cfd3288774/global-pull-secret-syncer/0.log"
Aug 05 17:22:17.329809 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:17.329732    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qc4nf_c996b690-5c12-48cb-8918-a4ca649da788/konnectivity-agent/0.log"
Aug 05 17:22:17.421759 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:17.421726    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-153.ec2.internal_d3090c32a53f05cda58fdc9e5efc8d30/haproxy/0.log"
Aug 05 17:22:22.176772 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:22.176742    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-p9jz7_32035862-e374-419f-ba1f-06fa7dfe3d94/manager/0.log"
Aug 05 17:22:22.212185 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:22.212154    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-ql82n_9313738c-2854-4bfc-a425-bbdaf8557822/manager/0.log"
Aug 05 17:22:22.411628 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:22.411601    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-x7cbq_94800ea5-0190-4c01-b71c-523c3bb0674d/limitador/0.log"
Aug 05 17:22:24.634739 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.634709    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wfbvt_b73a436f-ac07-445c-94a6-f4f0e0d1143f/node-exporter/0.log"
Aug 05 17:22:24.661190 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.661165    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wfbvt_b73a436f-ac07-445c-94a6-f4f0e0d1143f/kube-rbac-proxy/0.log"
Aug 05 17:22:24.684876 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.684853    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wfbvt_b73a436f-ac07-445c-94a6-f4f0e0d1143f/init-textfile/0.log"
Aug 05 17:22:24.714592 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.714568    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nm8mh_62f99e9a-a36f-4fca-9cea-64a532717b35/kube-rbac-proxy-main/0.log"
Aug 05 17:22:24.737228 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.737204    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nm8mh_62f99e9a-a36f-4fca-9cea-64a532717b35/kube-rbac-proxy-self/0.log"
Aug 05 17:22:24.775649 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:24.775624    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6bb4d7b4dd-nm8mh_62f99e9a-a36f-4fca-9cea-64a532717b35/openshift-state-metrics/0.log"
Aug 05 17:22:25.024027 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.023937    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-8h7fl_e1967d6d-d697-4ea4-bcf2-78b334e84b43/prometheus-operator/0.log"
Aug 05 17:22:25.064057 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.064028    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-758d7cb874-8h7fl_e1967d6d-d697-4ea4-bcf2-78b334e84b43/kube-rbac-proxy/0.log"
Aug 05 17:22:25.096864 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.096832    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-66685ff6d4-df6ts_51b2935d-3317-4e59-ab12-4528e8c322a4/prometheus-operator-admission-webhook/0.log"
Aug 05 17:22:25.268134 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.268088    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/thanos-query/0.log"
Aug 05 17:22:25.314919 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.314849    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/kube-rbac-proxy-web/0.log"
Aug 05 17:22:25.356870 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.356845    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/kube-rbac-proxy/0.log"
Aug 05 17:22:25.396788 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.396760    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/prom-label-proxy/0.log"
Aug 05 17:22:25.436933 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.436906    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/kube-rbac-proxy-rules/0.log"
Aug 05 17:22:25.477861 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:25.477835    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8574cd8b8c-v4nxc_97225a65-c434-4f21-8a61-80e50eb79cc9/kube-rbac-proxy-metrics/0.log"
Aug 05 17:22:26.707242 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:26.707210    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-f77f48c6d-s7lpt_c357fccf-9a2f-47eb-846c-f5bcee45bcc3/networking-console-plugin/0.log"
Aug 05 17:22:26.815204 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:26.815173    2546 scope.go:117] "RemoveContainer" containerID="f8aeb390d3e3ed25953063e0465957ef7b75d29a8a8b33c73a0d3a1bcf08be05"
Aug 05 17:22:26.823931 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:26.823913    2546 scope.go:117] "RemoveContainer" containerID="f63ffafc79f11f64f74feb66b3e597c24f3cde05d58cc396ebcee88fc7f75cd0"
Aug 05 17:22:27.024920 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.024831    2546 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"]
Aug 05 17:22:27.025345 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025310    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="874d9095-eff9-49e8-b180-fea802ff2a60" containerName="revoke-keys"
Aug 05 17:22:27.025492 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025471    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="874d9095-eff9-49e8-b180-fea802ff2a60" containerName="revoke-keys"
Aug 05 17:22:27.025568 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025528    2546 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" containerName="payload-pre-processing"
Aug 05 17:22:27.025568 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025539    2546 state_mem.go:107] "Deleted CPUSet assignment" podUID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" containerName="payload-pre-processing"
Aug 05 17:22:27.025675 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025664    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="8de0fe84-1050-4af7-9abe-53c5e633ea0b" containerName="payload-pre-processing"
Aug 05 17:22:27.025725 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.025680    2546 memory_manager.go:368] "RemoveStaleState removing state" podUID="874d9095-eff9-49e8-b180-fea802ff2a60" containerName="revoke-keys"
Aug 05 17:22:27.030498 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.030479    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.032698 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.032675    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjxd8\"/\"openshift-service-ca.crt\""
Aug 05 17:22:27.032816 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.032774    2546 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sjxd8\"/\"default-dockercfg-mnzst\""
Aug 05 17:22:27.033159 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.033146    2546 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sjxd8\"/\"kube-root-ca.crt\""
Aug 05 17:22:27.038109 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.038085    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"]
Aug 05 17:22:27.151645 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.151611    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-podres\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.151832 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.151667    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-proc\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.151832 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.151724    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ntv9n\" (UniqueName: \"kubernetes.io/projected/959b8f68-6016-4b2b-a336-2e28347ca56e-kube-api-access-ntv9n\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.151832 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.151782    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-sys\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.151832 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.151807    2546 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-lib-modules\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252450 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252418    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-lib-modules\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252481    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-podres\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252527    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-proc\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252564    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ntv9n\" (UniqueName: \"kubernetes.io/projected/959b8f68-6016-4b2b-a336-2e28347ca56e-kube-api-access-ntv9n\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252603    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-lib-modules\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252662 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252629    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-podres\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.252941 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.252714    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-proc\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.253189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.253050    2546 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-sys\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.253189 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.253163    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/959b8f68-6016-4b2b-a336-2e28347ca56e-sys\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.262414 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.262394    2546 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ntv9n\" (UniqueName: \"kubernetes.io/projected/959b8f68-6016-4b2b-a336-2e28347ca56e-kube-api-access-ntv9n\") pod \"perf-node-gather-daemonset-hf7hz\" (UID: \"959b8f68-6016-4b2b-a336-2e28347ca56e\") " pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.341733 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.341695    2546 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:27.416296 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.416264    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/1.log"
Aug 05 17:22:27.421427 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.421364    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5ccd6b445f-c6b7r_eb2d8dcf-0136-4937-8245-f28637046bb2/console-operator/2.log"
Aug 05 17:22:27.498688 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:27.498660    2546 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"]
Aug 05 17:22:27.500807 ip-10-0-134-153 kubenswrapper[2546]: W0805 17:22:27.500781    2546 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod959b8f68_6016_4b2b_a336_2e28347ca56e.slice/crio-514e95311a7c247a28c996ad3987c18da9f7d5fee30e1e67937215aef41ad359 WatchSource:0}: Error finding container 514e95311a7c247a28c996ad3987c18da9f7d5fee30e1e67937215aef41ad359: Status 404 returned error can't find the container with id 514e95311a7c247a28c996ad3987c18da9f7d5fee30e1e67937215aef41ad359
Aug 05 17:22:28.018487 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:28.018407    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d7d988cdd-tk7px_5438157e-2842-4835-b49a-8e17d5247375/console/0.log"
Aug 05 17:22:28.161070 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:28.161035    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz" event={"ID":"959b8f68-6016-4b2b-a336-2e28347ca56e","Type":"ContainerStarted","Data":"c82ba3723576d3fbfab07882c20263102baa7d08bd65a095201ff7efbbf5318a"}
Aug 05 17:22:28.161221 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:28.161125    2546 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz" event={"ID":"959b8f68-6016-4b2b-a336-2e28347ca56e","Type":"ContainerStarted","Data":"514e95311a7c247a28c996ad3987c18da9f7d5fee30e1e67937215aef41ad359"}
Aug 05 17:22:28.161221 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:28.161148    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:28.179601 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:28.179549    2546 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz" podStartSLOduration=1.179534085 podStartE2EDuration="1.179534085s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-08-05 17:22:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-08-05 17:22:28.176715667 +0000 UTC m=+3662.438026264" watchObservedRunningTime="2026-08-05 17:22:28.179534085 +0000 UTC m=+3662.440844682"
Aug 05 17:22:29.742703 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:29.742673    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jgrj_911bcb4c-3fdd-42b4-8372-34fcdd33e8ff/dns/0.log"
Aug 05 17:22:29.767248 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:29.767218    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8jgrj_911bcb4c-3fdd-42b4-8372-34fcdd33e8ff/kube-rbac-proxy/0.log"
Aug 05 17:22:29.930180 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:29.930156    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rlt9g_0be5ac93-18ef-4053-b0c4-9a0116de7d59/dns-node-resolver/0.log"
Aug 05 17:22:30.501502 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:30.501466    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6f78d4bd5c-v6kcn_c13b6e6a-7780-4971-b664-5a242db7fd59/registry/0.log"
Aug 05 17:22:30.576461 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:30.576432    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p6k5l_78fb5a58-5e23-4e38-9adc-881a59ef49b1/node-ca/0.log"
Aug 05 17:22:31.655661 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:31.655632    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s55pd_3528698f-27a0-48d1-8663-7466bfdc61b0/discovery/0.log"
Aug 05 17:22:31.678581 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:31.678557    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-6v9n6_06549988-9852-4703-afee-39e26cd336a9/kube-auth-proxy/0.log"
Aug 05 17:22:32.653191 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:32.653160    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-24c8s_f4d3f46d-b3b5-4cb7-a948-cb0e155f5aea/serve-healthcheck-canary/0.log"
Aug 05 17:22:33.226913 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:33.226878    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-2p9n8_500f22c1-607f-4cc9-8e24-dad8fcbf5a28/insights-operator/0.log"
Aug 05 17:22:33.227376 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:33.227360    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-77696685b-2p9n8_500f22c1-607f-4cc9-8e24-dad8fcbf5a28/insights-operator/1.log"
Aug 05 17:22:33.337358 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:33.337311    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhj86_f5a8ad5b-f1e8-435d-ab33-cabe36c71151/kube-rbac-proxy/0.log"
Aug 05 17:22:33.360663 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:33.360636    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhj86_f5a8ad5b-f1e8-435d-ab33-cabe36c71151/exporter/0.log"
Aug 05 17:22:33.384943 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:33.384918    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lhj86_f5a8ad5b-f1e8-435d-ab33-cabe36c71151/extractor/0.log"
Aug 05 17:22:34.177442 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:34.177414    2546 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sjxd8/perf-node-gather-daemonset-hf7hz"
Aug 05 17:22:35.906280 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:35.906201    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w6jqw_b8d61e39-229b-40b9-9e7e-bbb43570b45f/manager/0.log"
Aug 05 17:22:36.134522 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:36.134495    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-79cf6_96c67940-d5aa-4690-8391-9a5c08d301fd/manager/0.log"
Aug 05 17:22:36.314656 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:36.314626    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fkjrn_b6b67f64-253f-4404-862f-3afded59a9ea/server/0.log"
Aug 05 17:22:36.397333 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:36.397287    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-l64rq_7513a5ab-c148-48e2-8026-d44974934808/manager/0.log"
Aug 05 17:22:36.608201 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:36.608172    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-zfxtw_7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d/manager/0.log"
Aug 05 17:22:36.631971 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:36.631947    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9778877d8-zfxtw_7cbdbf95-adcf-4e5b-8bb5-ac34ba16405d/copy-manifests/0.log"
Aug 05 17:22:37.939758 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:37.939728    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-f95gc_d2260aed-8317-455c-b8c5-1244cbaefcdd/openshift-lws-operator/0.log"
Aug 05 17:22:37.957479 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:37.957452    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s55pd_3528698f-27a0-48d1-8663-7466bfdc61b0/discovery/0.log"
Aug 05 17:22:37.968636 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:37.968613    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-6v9n6_06549988-9852-4703-afee-39e26cd336a9/kube-auth-proxy/0.log"
Aug 05 17:22:39.678613 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:39.678583    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s55pd_3528698f-27a0-48d1-8663-7466bfdc61b0/discovery/0.log"
Aug 05 17:22:39.691562 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:39.691542    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-8f6d6f675-6v9n6_06549988-9852-4703-afee-39e26cd336a9/kube-auth-proxy/0.log"
Aug 05 17:22:43.447348 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:43.447250    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-54g4c_45be7fc4-a472-4a10-96ed-336064a45184/kube-storage-version-migrator-operator/1.log"
Aug 05 17:22:43.448205 ip-10-0-134-153 kubenswrapper[2546]: I0805 17:22:43.448185    2546 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7878f4b88c-54g4c_45be7fc4-a472-4a10-96ed-336064a45184/kube-storage-version-migrator-operator/0.log"